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ABSTRACT 


This thesis describes an experiment concuctead at tie iavel 
Eu: onotcewcHuool (iPS) during the period 15 October 1925 
Borough 26 October 1985. О ООС ОУ, the experisert evolvates 
1 - бып window" wicrocomputer technology, continuous speecn 
reccgnition equipment, and standard computer Keyboérd entry to 
input commands in a command and control environment. Using the 
Naval Warfare Interactive Simulation System (HNWISS) as a controlled 
medium, military problems were posed to test subjects in specific 
light and noise environments. 

Although the resultS are not entirely conclusive, they do 
mmonstrate a distinct advantage in using continuous speech or 
keyboard entry modes over the drop-down wirdow technology of tne 
ШЕЙПУСӘП Qf subject training time is not a significant restric- 
tion). Eitber the continuous speech, or the keyboarc method was 


Саи у superior in all environments. 
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I. INTRODUCTION 


A. OVERVIEW 


=] 


СООТ ШОО И  сгессессс ехролесс1а11у суег tne pest 
ОООО ears AS e result, work is now beins completed tore 


~ 


27 9 


3 
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BENE cnily andorrexpensively than ever before. 'evertneie 
NI ОП а myriag of aveilanle computer options, it berocves 
mayemindiVidual user to choose one that is not only user frienalv, 
mes both cost effective and a proven performer. Tinie паз 
always been a critical factor for any business, anó people are 
uu celizing that using a computer oniy constitutes the first 
meme coward achieving reductions in this area. 

In recent years there has been a moverent afoot cto simplify 
the all important man-machire inrterface which counts so neéavily 
muEcueine efficiency computstions. While the computer keybozsra 
has long been the industry standard; its speed is severely linitec 
Ex coskill/training of the user; апа the subject's knowledge of 
the particular command keys. Due primarily to these reccgnizec 
meai ons, more attention is being paid to a faster, ana соке 
sophisticated means of conmunication between user and шасп1пе: 
Euunstic Speech Recognition (ASR). This concept was first introduced 
in the late 1950's, and significant progress was made within tre 
EET IS years. It is known that free speech, in its natural 
Nus the fastest and most economical means for homo sapiens 
CO communicate amongst themselves. Applying this fact to tie 
user-machire interface cilemma, it has been shown that machines 
ПОС опіу be taught to responda to any languages but that 
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Speech for this type of communicaticn leaves the user's hands ana 
feet free іп огаег to perform important Concurrent Cune ни 
(1.е., viewing craphics screens cr cecision support aids, perse 
interface, etc.). While acmittedly the progress toward’ an ессе 
ically feasible voice recognition system has keen slov ШШШ 
products are now making themselves Known in industrial, military 
anG security-orientec applications. It 1s this encouraging Creme 
ссир1еа with the significant eccorplishments in each area of use 
that leads researchers to believe in its unlimited potentiel. 
[Re£. l anda 2] 

The newest development in interface technology is the "pull-dGown 
window" incorporated in the Macintosh microcomputer. (See Enclosures 
1-6 in Appendix G.) This methodolocdy, in conjunction with the use 
ct a mouse peripheral input Gevice, presents a "rectanculer-shapec 
препа" оп а computer screen within which the user writes ana reacs 
data representing a procram in the computer. Because the moverent 
of the cursor matches the mnovement of the mouse, the user reec 
only glace the cursor on the aeSlrec commana and press a conveniently 
located button for instant activation.  Altbouch no corparisons 
(individually cr collectively) have currently been made with the 
more tracGitional interface Gevices because of its recent emercence 
in the marketplace, its ease of use anc efficient cperation bear 
true witness to its untapped possibilities. [Ref. 3] 

This thesis is concerned with evaluating the speed, accuracy 
ana efficiency of the three previously describec input cevices. 


Тре data аабћекес for analysis was generated by subjects 


қ 


ОООО ОЕ ШОО itl an GE periment using the Naval karrere Interactive 
ee OW sy ate Athy ioo), end Will be discusseo in detil in 


later sections. 


ПОН УСОРЕ OF THE THESIS 

Пештера пшшегоц5г experiwents concernina automatic speectc 
pecognition have been conducted at the Haval Postgreduate Sorioo. 
Eu enterey, California, ecnly one previous experiment (conductec 
by Wright ana Hanson; two NPS graduate students) has attenptea a 
EE rehensive evaluation of computer input technologies ir e 
military command ana control environment. That experiment was the 
5с аССеирс to evaluate two voice recognition systems of Giffering 
technologies, besides tne more conventional keyboard (typing) 
mode of input. [Ref. 2] 

Pecepting the concluSions drawn in the Wright/Nanson thesis as 
a basic premise, tne Discrete Voice Syster. (Threshold) was eliminated 
as a possible candidate for further experimentation. This decision 
was based on its record of poor performance ir the experinent, 
and the requirement of a discrete system to speak in broken 
Euuses wbich 15 unnastursl and cumbersome to human beings in 
шета. Since the keyboard was highly successful aS an input 
(шеслот 1п the previous experinent, the results were used eas e 
КИ сопраг15оп ака1п5б the two newer mediums selected in tnis 
experiment. Because the Wright/Manson experiment usec the зе 
WISS wargaming scenarios, it was not only unnecessary to repeat 
BU rocedure,.; but it allowed for more concentration on the 
ОШО ас сп cf the possibilities present in the "newer medias". 
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tne basic purpose cf this experirent was го ечсї1 к гени 
input interfaces to tne LWISS wargame всепагіов гесісепс ой 
Digital Equipment Corporation's VEK 11/780 corputer) 2 
Selected tne appropriate input media (1.е., ле Настосо5и пон 


S 
t 


Er 


computer with drop-down window tecnnolocy, сие ио NE NE 


= 


үл 


=ч 


with Automatic Speech Recognition capability and tce регис 


(m 


keyboard attacnec to the VAX Soar IS it was necessait amn 
establish certain Measures of Effectiveness (HOE's) оп СИИ 
base the ensuing comparisons. It was decided that спе nún cioe 
commands entered during one WWISS warganing session would be the 
огіпаѓғу MOE. Tnis coupled with the number cf Control K's m c 
errors made by the user) entered would provide the necessary data 
in which to answer the following questions: 1) Was any syster: 
more effective, and or easier to use?; 2) Was any systen tore 
effective under the varied environmental conditions?, end 3) Vas 
a clear learning curve established as a result of more рга 
ме <a particuler input device: 

This thesis will not include a description of tne constr i 
process used to devise the wargaming scenarios, ог ргоулсе и 
methodology used to build the operating system; since they сени 
already exist. Additionally, the development of the VAX 11/780 
and the resident NWISS is already complete anc will not be ас сосе 
All conclusions from the experiment anc the author's recomendations 
for follow-on experimentaticn/study succeeds the anali < T EESE 
data, and will provide some insight for the future изе сы 


burgeoning technology. 


ie 


С. SUMMARY 


i 


ет м ге а сессргаретси ог toe initial ezperiuent, 


4 


Моши, а.:! procedures and Басе гоипс material precedin: its 


ШОО ООО А Ыш агу оГ basic Speech recczniton tecnnolo;y, 


Ca 


EDU tosnhnmicrecom:ruter technology and s review of past experiuent 


ps 
0) 
= 
СУ. 


ИІ Speech recognition at LPS is ргочіаеа іп Chapters I 
ШО tne design process for this experiment (i.e., design of the 
Eusrros, determination of environments, background of the 
ERDNCCUS. and practice/training sessions) is given in Chaptėérs 
IV, V and VI. Analysis of the date from the experiment is provided 
EN парсег VII. All experiment conclusions and the autnors' 
Meeontendations for further study/applications follow the analysis 
of data section. 

mependices Е апа C provide detailed guidance for follow-on 
КОО ез Using Vertex 3000 ог Nacintosh microcomputer tecnnolopgy: 


respectively. 


II. SPEECH TECHNOBOS 


A. INTRODUCTION 
Tne use of Continuous Speech Recosnition Systems nhas eoe 


Significantly over tne pest trree tc five years. ЕГГЕР Ы 


findin;a success with discrete systeus, док 135 now Сеп. Шаа 


+. 


duced for use in critical reas of орегабјоп. Тге ргоггеза ааа 
in recent years is measured in many different ways. The 1.055 
obvious is the performance and capabilities of the macine e E 
cf the other criterié, however, are equally important. Trese 
would include increased vocabulary size, distinguisring бен 
easily confusing words ana minimizing the effects of nO и 
other interfaces. This chapter will discuss sore ог сие тей 


behind Continuous Speecn Кесовтј стоп но вене 


В. DEFINITION OF TERMS 

The real meaning of speech recognition may seen intuitive, 
but its derivation and appropriate applications will бе сезони 
further to preclude possible confusion, and to provide 2 сои 
base for universal understanding. 

Speech Recognition can be defined as the process о: стан 
forming the continuous acoustic speech symbol into оке я 
representations. These symbols may be essigned ргорег геа ыш 
and when comprehended, may be used to affect responsive behavior. 
The next major distinction is made between Connected (Conti nton 
Speech, or Isolated (Discrete) Speech. Connected Speech is that 


in which there are no Significant pauses. Ап example коша сени 
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ОО ш <р оке ал 2 поггаі rete. It is 8 difricult tas« for 
МО ОООО Е со а:5ејпец155 between where one word ends, and the 
mext word be ins. Isolated speech does not have this probler, 
НЕ =) о са peuses (Cr.e.,— Turm--Latne--On) are СІсег епоџ-! 
а | 1 ом distinction. ПШ ООШ те! coal of shy согрцђег 
EE: "s tO rapidly anc accuretely interpret the user's input, 
and then eect and responc approprietely. леге КОЛ го COULE 
meme it is easier to make conputers recognize words 5рскеп in 
lsoletion, or at worst, spoken in broken phrases. In fact», there 
ere several examples of this on the market today. Ву tne sane 
token, however, speékirg with isolated words or broken pnrases is 
difficult for humans to achieve, and rence not desirable. (Ref. 4 


aac 5] 


С. CONTINUOUS SPEECH RECOGNITION BACKGROUND 

ШЕ (Пе cost of equipment declines. Continuous Voice Systems 
are receiving increased attention. Concentrated research started 
in 1971 when the Advanced Research Project Agency (DARPA) of the 
КО геп Ot Defense allocated $15 million dollars towarc a 
program called Speech Understanding Research (SUR). It was tne 
largest single project ever undertaken in speech recognition, and 
eumeecedec in developing macnines that were capable of "understanding" 
continuously-spoken sentences involving a 1000-word vocabulary. 
[Ref. 6] Although the DARPA project was not the first to research 
continuous speech recognition, it spawned the ideas of several 


ВЕК companies who followed suit shortly thereafter. 
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DARPA project came to an ena in 1976 with a Tone cm. PE 


Є3 
ој 
о 


Geroonstration of several new systems that could ипсег5зстапс сорс 
spoken sentences. Even tnougn the results were fer fron pem 
tney were extremely enlightening. The Harpy System for example, 
far exceeded its design goals by correctly understancirne 
the sentences spoken by five speakers. It used a 1011-мого уосас- 
ојегу, anc a hignly-constrained granier cf sentences relevant to 
a task concerning the retrieval of documents from the со 
тепогу. 

In 1973, IBM developed a system for sutomatic recognition of 
continuous speech that correctly recognized 96% of the ТОРЫ 
numbers, with a per-digit accuracy rating of better than ЭЗ 
1976, Texas Instruments developed a system successful in verifying 
the speaker's voice before permitting access to the medium itseri: 
pero 5 

At present, there is a great desire to improve the quali: 
continuous speech recognition technology. Due primarily ВоВ 
increased speed, naturalness and mobility», researcher: Б 
recognized its importance in папу varied applications (1.е ЛЕНИ 
Traffic Controller training, key word identification in поп ин 
conversations, conmand and control environmentS, cockpit communi-= 


cations, etc.), and the necessity to exploit 211 сараси 


D. TYPES OF EQUIPMENT USED 
The NWISS was the nucleus of this experiment. In ado ин 
the VERBEX 3000 and the Macintosh microcofiputer were cor! Tage 


for use as two cf the experimental input mediums, and tne peripheral 
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keyboard attached to the VT1C2 terminal of the VAX 11/780 used as 


we ttrird. 





Dee УУ 2000 isWweurrently the "state of tne art" 


тыз 
ae tw й 


Бәлен рсестикесооті тет Sysvens. It is d 
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< я 
.2 2 


(D 
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Qo 
го 
с 
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ror mse in industrial and commercial applic 
ШИЕ)! іп both high and lov noise environments The system is 
ED lecof recognizing natural continuous speech of infinite 
Шс. and an output buffer of 2HO0 characters per recognition 
Es its only limitation. {Кег. 7) With a maximum of fcur 
speecn processing boards, the VERBEX 3000 can recognize up to 360 
different words spread over as many as 20 different granmars. А 
бабе 11116 to grammar size, based on the total number of worcs 
ПИ сопр1ехітгу of the node transition network» is necessary to 
БИК спе device to remain "real-time" sin terms of conputetion 
Speed and menory (i.e., stored voice patterns) requirerents. Thus, 
оте total application may involve up to 360 words, but at any 
instant the recognizer is dealing with oniy one grammar subset. 
[Ref. 8] The VERBEX 300€ system includes the Speech Application 
Development System (SPADS). This system allows the user tc run 
applications/software other than those procucec by УЕКБЕХ 3000. 
Nevertheless, any progran must be written in the programming 
language Pascal in order to effectively control the applicaticn. 
ШЕРГЕ Спгоцпеп the use of SPADS that Lombardo (an NPS graduate 
Student) was able to develop a progran in which voice commands 


Ем 5есо in conjuction with the wargaming scenarios usec in the 


i7 


VISS. [Ref. 61 Aaditional equipnent for tne УЕКБЕХ 5000 по ва 
a smell speech unit which prompts tne user ror the tiext) Мор 
phrase. This unit wiil echo the command if subsets сі pnpocscem на 
needec tc cornpiete the command. Ihe subjects іп miS exp 
used a Shure SHl2À neadset (clcse-speaking) тісгорпопе Га 
Gecicated input device), and tne Siegler ADM 31 terminal come 
the VERBEX 300C system with the VAA 11/780. This partem 
tern.inal echos all user inputs including conmancs anc ева 
icentifiedog as Controli kis. 
c Labporetory Eguuwppent 

This experinent required three irnput/cutput terum 
(VT-102 series), three status board terminsels (VT-100 series)-amd 
three Ramtek color graphic display terminals. The türee пришло и 
terminals were assigned as control, umpire and master аса 


subject (as well as the umpire) had a color praphic аір 


О 


view the scenario in progress. Status boards for the two БШ ekENS 
provided accurate combat information for the respective forces; 
and tne umpire had access to all information on a Special 5008 


board configured гог спас рит осо 


E. PREVIOUS NAVAL POSTGRADUATE SCHOOL STUDIES 

In the past several years, there have been a multitude ОГ 
experirents anc tneses developed at the HMPS to realize спе ресе и 
and limits of Speech Recogniton. This section will геу елы 
findings of a few of these studies as an attempt to summarize the 


progress to date. 
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ПИ ПО ге Оссо occurred which analyzed speech recognition 
РАН 20 ішігоуе speed and reliaoility in the task of iragery 
a erpretatiorn. Тре purpose of the experiment was fo allow ап 


у 


КОО ог со devote incre time te concertrate on tne object bein; 


C 


1 


emer tea, and 1eéSS Cine inpubirg ene inrcrsation on спе bheycoera. 
Du Screte vcice system (i.e. Thresncid, T6CO equipment) was 
шоа CO conduct the experiment, and the analyst founa that tune 
Voice system vas approxinstely 507 faster than typed data ertry. 
Er 25 "reporting accuracy", no significant differences were 
Moced. (Ref. 9] Concurrently; in 1981 a NPS student studiec the 
Eu оса ту оГ using voice systems in a war ganre environment. 
Mie objective here was to play the game scenario utilizing а 
we erete system (T600) and a standard keyboard. Performance 
peures that vere evaluated included time requirec for eaon 
Endo the number of input errors. The game, entitled warfare 
EN uonpsmental Simulation (WES), (later evolved into NWISS) proviced 
HE EMHLeractive, real-time wargame used in this experirent. The 


~ 


student's experiment suggested that the keyboard entry was fester 


6% 


and resulted in fewer errors. (Ref. 10] Why then was there a 
difference in outcomes between these first two studies? Apperentiy, 
meemsisetlod of measuring the errors was different ir the VES 
те т епс. The total errors for tle vcice ertry included recor- 
nition and operator errors, while the keyboarc entry totals only 
Mierudea the typing errors. For the imagery interpretation exper- 
iment, the methods used to measure errors for totn irput devices 


Ddentical. 


several otner experirents using discrete Systems чеге с О ы 
with similar results. Tne "better" method depended or the сез cm 
МОЕ, the experience level of the subjects, the extent ова 
Сет Е Ol the сы оос еее 

in 1964, anotrer ['PE student aevelopec a thesis слаб грешци 
to evaluate the use of continvous vcice recognition Cec r eae 
in a wargame environment. The student developed the applicaticn 
software to run the NWISS wargame using the VERBEX 3000/corn ин 
speech -systen. This software becane the foundation ТОР 
vright/Manson thesis; the final thesis before this exper memi 
The authors of the бпез15, Wright and Папвоп», еугілнасес 
effectiveness of three input devices (continuous speech, ciscrete 
speech and the standard keyboard) while running the NWISS wargame. 
Тһе nonintuitive conclusion suggested by Wrisht and tanson was 
that the keyboard players did better overall. Further research 
gave scme possible plausibility for this resuit. During low dl 
sessions almost all the keyboard subjects movea tle key ormi 
panel closer to the СКТ to alleviate a perceived гапајсар. А 
experiment survey also revealed that the keyboara group паси 
highest typing skill level of the three groups. Ккда1ејопа m 
the discrete system fared well below the other песповз іп (58 
najority of the comparisons, and even though shorter traim ior ин 
required, incorrect recognition was more likely to оссо 
varying levels of ambient noise and dissimilar user vcice patterns. 

From the results obtained in the Wright/Manson Спезл5 пити 


be ascertained that while the keyboard still remains an alternative 
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[Ог сОоприїег 1пїегГасе, the discrete system (however efrective it 
56) 15 HOw Mettiral to an individual's vay of speaking» auc 
Mees Not merit further investigation. (РО ле Т Оу, 110) 15 2150 
Meer Zea that more evaluation of the continuous speecti recopriticn 


гг 15 песоес, and it shall be ciscussec rurtkher in leéeter 


merece rs Of this thesis. 


Е. PROBLEMS OF SPEECH RECOGNITION 

With any field of study tnere are many proolers which tend to 
wn cer the progress of new technology; and Continuous Speech 
iMemernology is no different in this regard. Nevertheless, several 
additional factors must be considered when human behavior is 
involved. For instance: Can an inexperiencec user operate a voice 
system? Will the system accurately recognize an individual's 
uoce signals? In genersl, the bigger the system's vocabulary 
Sagacity, the more prior 2 will бе гедијкеа. АБСО а 
large nuriter of sentences and alternative phrases need to be 
recognized, additional training may be necesSary. The vocabulary 
Mesel plays an important role in determining the systems ability 
ШИГЕсСовпіге utterances with any degree of consistent accuracy. 
BEN Г ег words, it is much easier to recognize 1С0 distinct 
words, than to recognize 100 "rhyming" words/phrases (i.e., a 
Emm ne house" vs. a lighthouse"). 

wener difficulty occurs when there are "highly constrained" 
Sequences of words (i.e., stcck numbers, telephone numbers, etc.) 
p cperully formatted phrases (і.е. ,. air traffic control conmands, 
fixed-length commands with each word selected from a predetermined 
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vocabulary, etc.). These words or phreses require a pore сорт 
analysis to insure the proper context orea ME It is akg 
extremely important that the speaker articuiate/annunciate each 
WOCO Ге Со танак 

One ot the biggest difficulties encounterec when сегітп ы 
Speech recognition is the unwanted ability of the micropro E 
pick up outside noise, or sounds from the environment. While it 
is a fact that real life conditions nay encounter аас ни 
noises causing degradation in the systems ability to accu MM 
recognize words, the judicious use of avéeilable testing facil pm 
will allow optimum conditions on a regular basis. Another сове и 
solution is to use "close-talking" microphones or hea њи 
Tnese particular devices are able to differentiate between nearby 
sounds and sounds heard at a distance. [Ref. 6] 

Cost is another very common problem with this technolo: s EN 
Research and Development companies and comrercial users ы 
initial cost is very high. At this point in time, спе denic rr шшш 
contiruous speech recognizers is not enougb to stimulsbteMNT 
significant number of grants and contracts necessary for seg ш 
research. 

The question that is uppermost ir the mirds оГ тапу соге н ш 
investors is not whether the equipment is affordable, Бити 
it necessary? Do we really need a continuous speech recognizer? 
Some people argue that “isolated word recognizers" ere adea 
Гог most jobs. The fact stiil remains there is little dourte 


if improved, the sheer motility and flexibility ог сопа 
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Systems would easily surpass the cumbersome cperation 





in discrete systems. 


23 





III. MACINTOSH MICROCOMPUTER TECHNOLOGY 


A. INTRODUCTION 


Although the ocas against its fruition зеепес поппмепса и 


C) 


1979, the Hacintcsh microcomputer, designed by a Stall Hn ни 
inexperienced engireers ang prografiners, is now recognized vicr la= eee 
as a technological marvel in personal computers. Reiying heavily 
on symbols and associated pictures on the screen, 10 15 се ыа 
prinarily to help people conquer computer photia and ое 25 еа- 
to use as a television set. It is this ease of use attritutemeae 
made it so attractive as a possitie testbed interface device i 
Wwargane simulation. [Ref. 11] 

This chapter will focus on some of the terminology inherent 
in microcomputers, described the origin/backpround 5игргош 
Facintosh's innovative technology and its adaptability to espe 
mental design, and lastly, describe the е Ор that was used 


in the experiment. 


B. BACKGROUND 
The Apple Corporation's Macintosh micecrocomputer is Dun NM 
three (3) primary ideas: 
1) secondá-generation Lisa technology (en expensive desktop 
computer designed for conmercial use that pioneered tne 
mergirg of graphics and "mouse"-oriented pem uM 


operation), 


2) reliability and low cost through inbred simplicity, 
and 


СА) 


a maximumization of the synergism possible Бебмееп пагечаве 
and software. 


eH 


Pemerec оу thie Gecicated ambiticn cr Burrell Smith (a former 
fore Computer Corporation méintenance technician) Steven Jobs 
Мо сла:гпап cf Atple, end the Hacintosh project director) and 
ссе project team of "visicrary radicals", Apple has succceced 
Memeecreeting a machine tuat welghs only 20 роџпаз» cén Ce carries 
ПК осе бас апа kas nany of the significant feetures introduced 
uu anuary of 1963 with the Lisa computer. Although it uses a 
mouse" (a pointing device roughly the size of а pack of cigarettes) 
Enat permits users to give commands to the computer via erm/hand 
movements and button pushing, there are four (4) basic aifferences 
from the Lisa that make it second-genersticn oriented: 


1) не йек el Ock зреес (7.63 MHZ vs. the Lisa's 5.0 
MHZ), 


2) Smaller memory used crore efficiently through the МС68000 
processor, 


3) an elimination of add-on peripheral cards throush the 
extended use of a high speed serial bus coupled with tne 
И оше елу О сло virtual lote", and 


It allows only one applications program to be active at a 
time (an important limitation). 


ШО ОШОО this letter limitation spect Seens serious in 
иге, it actually facilitates the use of multiple window operations 
Mea lovs material to be "cut and pasted" from one document to 
another by a "clipboarcG" arrangement. Nevertheless, the abdsence 
 багсчаге slots and the lack of ability to run two simultaneous 
applications are the two important separation criteria from that 


ШШ Пе Lisa technolcgy. [Fef. 12] 
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by combining tne functions of mery stendaerd chips іп(о бы 
programrable logic arrays, it makes it possicle for the i30 M 


to keep its chip count (and therefore its price) геї m 


ж 


wrile simultaneously croducing a mschine that nas a гета ы 
factor cnarécteristically essocisted witl much sinpler comm 
Nith only two printec circuit boaras, it was cleverly асле 
eliminate tne need for nardware fire-tuning during assem мн 
use. it is tnis combination of reliability and s*uplricitÓ 
makes it an ideal training or input interface. 

Tne Macintosh's hardware and software are fully optimized for 
maximum potential. This simply meéens that the hardwéere and scitware 
have evolved slowly over a period of time that has provided a 
mutual "give and take" association. As a result, the video o ин 
hardware design greatly simplifies the software design; а сЕ 
it to easily draw squares and circles, scale text anc ага а 
and print screen images. Utilizing tris feature to its ГТП 
Tom Concannon (a NPS praduate student) was able to develop the 
NWISS wargsue interface program in the BASIC language to eliow 
the experiment subjects to play the various wargane =сей и 
This program activated бһе "изег боо1бох", мбзећ 15 ргаша ни 
responsible for manipulating all the varicus relative relation ни 
between different units/accessories in the MC66000 processor. Эу 
Stimulating the window and menu managers, the subjects were then 
able to use the mechanical mouse to select wargame comnands froni 
a two-dimensional matrix of menu items. The selected input was 


coordinated through a resource manager facility which perpetuated 
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МО суепсиз! іптгегГасе necessary for communication end comui.asrdá 
ШіГпасіоп оп the VAX 11/760 computer. An example of etch menu 
Eun followed by 211 the possible user selections is contsired 
ENS ССО section oí the Macintosh Micrcconmputer User's 


Merde (see Appendix C). [Ref. 3] 


C. EXPERIMENT HARDWARE DESCRIPTION 

The Macirtosh has received numerous accolades for its lmpressive 
Een. It is truly a highly developed microcomputer that effectively 
uses a mechanical mouse peripheral апа а 32 bit microprocessor in 
fmmereticweight portable package. It is its portability, functional 
simplicity and ease of use that make it the ideal selection for a 
Meer interface device. 

The Macintosh microcomputer is a self-contained unit (9.75 by 
ПРУ 13.5 inches) consisting of a main unit» keyboard and 
mechanical mouse. It uses standard AC external power, hus two 
EI ports and an integral Sony 3.5 inch disk drive which holcós 
Го 400 Kbytes of information. Its standard 128 Kbytes of RA, 
and 64 Kbytes of ROM were reconfigured before the actual experiment 
to 512 Kbytes to accomodate the slignt command entry delay experi- 
ша by users at the lower configuration setting. The nine (9) 
ШОО monochrome monitor provided an adequate display of all 
Pictorials, and its 5€ key detachable keyboard served as a comfcr- 
table medium for a backup typing input mode. The main source of 
user input was a small mechanical mouse which is physically moved 
іп а rectangular series of hand movements to position an onscreen 
ӘМ (0 (пе desired menu. Keeping the index finger positioned on 


2 


a conveniently mounted button, the user manipulated tne mouse го 
position the zrrow, and used the button to extend tne сени 
menu end select tne appropriate comand for subsequent шее 


tation. A detailed description of the mechanics involved ІШЕ 


(1 


operation is again avallaole oy referencing Appendix COD OMM 
and 3] 

ВАНТЕК nigh resolution color grapnics топ1бог5 меге = 
display the game scenarios to the subjects at their respe ERES 
positions, and the digital VT1CO terminal was used as a status 
board for each NWISS session. Tne configuration of the 1200r. ии 
itself will be further described in Chapter VI, гипс а рзессшики 
display of the physical layout provided (see Figure 6.1). 

A conventional cassette tape recorder was used to play г 
pre-recordec background noise tape during each KWISS session. One 
eight inch, eight ohm speaker was ріасей ас а рге-езсартта а 
distance from each subject, and an audiometer was used to vermin 
the decibel settings for each light/noise environment species 
The pre-recorded noise consisted of a gathering of approxZmsbem 
thirty (30) people speaking in a converSational tone within an 


aug corium. [keir z2] 


D. SUMMARY 

This chapter has served to discuss some of the Сбегилто н 
inherent in the design/description of the hacintosh плесгосош M 
and has presented some of the background theory andri e 
behind its origin. Although there were no previous wargane Sce Tienimi 
experiments conducted at the NPS involving the use of Се мас DM 
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Шо: 1ак technolesy) as an input medium, its ease of use, anc 


Meer Overall potentiel Crompted itS employment in this experiment. 


ШОО ју, а description of the actual microcomputer гагачаге and 


Mepeocidated laboratory equipnent incitudec in the exteriment was 


Beovidec. 
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IV. THE NAVAL WARFARE INTERACTIVE SIMULATION SYSTEM (NWISS) 


А. | INTRODUCTION 
Tris chapter contairs a brief ceseriptron oto M пп 
support role in this experiment. Áll scenarios developed m 


experiment, the measures of effectiveness selected ana tne netrod 


о 


usec to collect data and compere the two command input technologies 


are also described. 


В. WHY NWISS WAS SELECTED 

NWISS is a real-time, user-interactive simuistiopr о а 
warfare. Its mission was originally to train senior haval Ofi аа 
іг force-level tactical decision makirg and management cf command 
ana сСопего At the Naval Postgraduate оспос1, KWISS resider Sanii 
a VAX 11/780 computer, and the peripheral VT1C0/102 termina ни 
PATEK graphics terminals provide the necessary 1при©/ ОШ ни 
modules when grouped together. Voice equipment (i.e.», the VEREEA 
3000), ana "drop-down" window microcomputer technology (1.е. EM 
Macintosh microcomputer) were used as interface cevices ІП 
available modules. and all inputs and outputs were accomp ЕС 
by traired subjects. NWwISS was loaded», controlled and monitcred 
from a third "commana" module during these ехрертпей и The 
purpose of iiWiSS in tnis experiment was to stinulete а 5етез ин 
environment that would aliow user intervention via lLWiss commana 
Fron the user's point-of-view, it has a large vocabulary 
commands to change the view of the tactical situation 100 


battle arena, cause cnanges in the course and speed of vehicles 
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EE ООШ о Фа а іІзПпсеп air assets with user сеГіпес weapor 
БТ (555 сап also show the status of the user's 
forces on several menu selected displays. For this experiment, 
EE stat*on consisteao of а cormrand input terminali, а force 
ENDS terminal and a videc monitor to grapbhicalily cisplay force 
Seeeeosition and identity. [Ref. 2) 

ШІІЗ5 мг5 used to Support this experiment because it: 


ООО СГОБЕСИСИе ао: су topresent icentical tactical situations 
(О ООШ ОШ Ее =оојесс5о Simultaneously. This controlled 
environment allowed a side-by-side coniparison of the conmana 
input wethods chosen by tne isolated subjects when confronted 
КОО ег саш ас нса! stimuli. Additionally, the system 
was readily available at the NPS, and a pool of trained 
operators were accessitle for "on-line" consultation. 


8. Provides a large system vocabulary. Consensus of opinion 
аа Sall vocabulary was chosen £o rur the 
Escuche csubyectsomay become bored through sneer 
cormand repetition. Approximately 150 words/utterances were 
ССП ee SS dary со properly conduct the variety of 
inherent missions within the capabilities of an Aircraf 
Carrier Battle Group. Twenty commands relating cairectly 
Пе ООШ СОО ГОТ от се асрісаі Гогсе display were 21850 
не аа. laoles of the complete vocabularies for the 
two input technologies are included in Appendices Е « C. 
These vocabularies were precetermined and were limited оу 
the size of the memory of the VERBEX 3000 system. Using 
воре час сошталаз im these subsets of the ALISS 
dictionary, four previously developed scenarios were used 
сш тов естпигасіпр subject inrterest, and for 
generating a meaningful HOE. [Ref. 14] 


In all four scenarios, the Orarge anc Neutral force acticns, 
Memensive posture anc radar emissions control (ENCON) status were 
 Ергоргаплес. Orange aircraft were eliminatec fromthis experiment, 
Шшамоја unnecessary system program complexity. The two available 
views of the world for the Blue forces were simulated on approxi- 
metely the sane latitude, but were physically separated in longitude 
бу 500 nautical miles at mid-ocean. 


~ 
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, 


2,155 is limited to a maximun of six sets cf вогссес ис 
Crange and Neutral forces were each structured aprropri2temmM T 
reflect one view. The specific process Ғог аѕзего Еи 
various views and overlapping them is explained in some сес 


asico Ti 


m~ 


y Owens and Broun «ле. инв 


(с! 
5 
) 


cr 


a orev ous ПРО 


с 


there were two separate views for the Blue forces which а БЕНИН 


the subjects to individually control their own Snips спа ое 


С. SCENARIOS 

Four unique scenarios were used in order to effectively place 
subjects in situations requiring the use of the гуалјасјеш ы 
vocabulary, and to stimulate individual/different responsesm 
section describes the basic opening force positions fOr бабы 
the scenarics and the accompanying miljtary situation ЕОС 
lor that scenarios The actual situation briefings giver 208 
subjects are included ir Apoena irki 

1. Scenario A 

Gne aircraft carrier, twelve P3C aircraft, two fries 

and an ettaeck submarine are assigned to the Blue forces) по 
forces include one aircraft carrier anc six surface сорасы 
апа are escorting eight neutral merchant ships іп а соро ы 
1S moving south as shown in Figure 4.1. The merchant соус 
reportedly carrying nuclear and chemical weapons to an uniden m 
Orange zlly. Hostilities have been declarec between tne Biue 
and the Orange forces and the objective is to identify enc des 
tne Orange escort vessels without involving/destroying the merchant 
SEDIS 
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ВН cenario e 

КО с ог (Ис РЗС aircreit to provide tre 
a e Ол naa ation, one aircraft carrier anc two 
о of Vve aleck alrcral t = four Crange surface combatents 
Meer poOsSiticnea between these Blue forces, and twenty rercenant 
ESI Is are at ancror cutside a fictitious harbor facility waiting 
EN сас their cargo. Eostilities have not been declared Себмееп 
meee anc Orange forces, although tensions remain Figh.  Tne Eiue 
force's mission is to use the assigned airborne aircraft, and tiie 
E Uning aircraft carrier based assets to concuct a strike on 
the merchant vessels. Rules of engagement do not permit firing ty 
the Blue forces until the Orange forces nave fired on them. Fror 
mae Opening positions as shown in Figure 4.2, neither the mercnant 
5 nor the Orange combatants are visitle to the Blue forces, 
ERES nortberly course is dictated by the mission. 

E Scenario C 

Manav Obaole environment is present in whicn Blue taskir: 
mmo Locate and identify as many objects as possible and deSlgnate 
Maem aS Friendly, Neutral cr Enemy. Blue forces have one P3C anc 
Mere rt4A aircraft to accomplish this mission, and Coribatants 
mor booth Blue de Orange forces, as well as several merchant 
memes and fishing vessels, are all in a 400 X 500 nautical mile 
Ее (аз depicted in Fig. 4.3). ОЛЛО ЛЕГО of tne blue 
mumrace forces was permitted to complicate the tasks of location 


Ка сеп: 1  1јса јопр. 


UJ 
C 


Two carrier tattle groups of approximately equal Stren 


are pitted ateirst e€acdVernage Dlue forces are зресігісе е 


ct 
p» 
C2 
>. 
о 
о 
ct 
C 
|— 


ocete and identify the eléments of tne Саг ЕИ 
bettle group, EHostilities neve noi been ceclarec, DUC Cite SEN 
were allowed wiae latitude in their response to алу Стане о 
aggressive action. The opening positions in Figvre 4.4 piece 
Orange force carrier battle group to the horth cf the васее 
group; with the Crange force headed North and tne ојце ЖБ 


headed to the Northwest. 


D. MEASURES OF EFFECTIVENESS 

All subjects were familiar with the KWISS warcaning scerariose 
some of the conmands (i.e., changing the scale of tne cmo Е 
меге easy to eccomplish and rapicly assimilated, whiie са 
(such as the launch sequence) required patience and сопз1дегас1е 
practice to implement correctly. When the subjects received TER ENE 
mission briefing before each session, they were told Sone o Шин 
measures of etfectiveness by which their success or failure Ы 
be determined. Included were such things as the number of merco mik 
vessels sunk or damaged in Scenario B, the numoder of 501р5 сорте 
located and identified in Scenario C, and the number onm M 
forces lost to hostile fire in Scenario АЛ (sec Appenon БИ In 
each case, the subject was urged to accomplish the оа EM 
the allotted time period (i.c TOR OCE DE These 10Е'5 were 
false sets of МОЕ'5, and although not used for analysis ooe 
intended to stimulate the subjects to achieve a meaningiu! coal. 
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Figure 4.1 Scenario A 
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Figure 4.2 Scenario B 
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Figure 4.3 Scenario C 
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Figure 4.4 Scenario D 


ево tC. tne 


| ~ 


Класа шп =азцтез ог е!:гесетуепез5з5 аге ге 
ог о: fk. ioo COrmenas entered ana thelr corresponding accuracy. 
Meee nlinoer ог Commands entereac was considered to be the mos 
ПИ и па сосос ог гиорјест estery over the input technique. it 
EE Ut that the four scerdrics, with the epplicetle combinaticns 
ПИШЕ nt ene norse Levels, provided the opportunity fcr tre 
ШОО ест to use commands available uncer varying environnental 
Eu Utrons. Real-world tine constraints and accompanying pressures 
were impressed on the subjects by the schedule, and by tne aelic- 
EE overt actions of tne facilitators. Since all the sessicns 
lasted the same number cf game tiinutes, the nunber of cornrmands 
entered was essentially a rate of entry. The astute subject coulda 
wwe increased this rate significantly simply oy repeatedly 
Но. їз Cl1spley racius. Бу stressing tne fictitiously generatec 
Ж ЕЙ 5, this type cf performance was indirectly discouraged. 

ia wuss determined through supervisor consultation and group 
EN Ory discussion that accuracy can be measured to Some extent 
Ине number of times the “"Control_«" command is usea to delete 
en attempted commend. Nevertheless, tnere are sone limitaticns 
to using "Control &" as a measure of the number of errors made Uy 
ОШ ес». Since ШЕ боге Ene current command and does not execute 
memeecne "Contrcl &" could be viewed as a change of mind on the 
В есс!' $ рагф. НЕН ЕСТІСІ experience With the RWISS came it is 
Ву to erter a completed command and issue a subsequent 


ENCction, аѕ it is to abort the command completely. [Ref. 2] 


Meeme ere also two equipment related factors that detract fron 


(т) 


[55 е 
52% 


tne use of "Control X" as an error counter. -1 Рас аа 


(1) 


000 speech recognition system, after the keybcara hnas bec M 


КҮ Т ^ 
кт | 


to enter én KVISS commend not includec in Спе 155 мога осам ни 


tne "Control AR" commana iS necessary to return to the De 


ә 


4 


O: the сог апат рис SecueNee nerefore,. tnis use of "Cor o 
Coes not indicete an error, out tne correct use Of спе а/ы 
seconcly, it could be that the subject's utterance/word mo 
recognized by the system anc the subject elected to entere 
conimand manually. The result is the same as in the Его ни 
tne abort connand must be used to return to the start of a new 
command input sequence. In a deliberate zttempt to alleviate this 
particular "discrepancy", the authors' evaluated the prir co oE 
the sessions immeciately following their execution so that текогу 
of the subject's rationale behind the selection of a Corte 
input could be interjected, and subsequently discarded if it) Wes 
not intencoea as an error correctio: Cverall, despite tnese 
considerations, it was felt that the "Contrcecl_K" command ров 
the best measure available of errors made in entering conum 
although it still may not be as strorg a measure as the Numa 


commands entered. 


Е. DATA COLLECTION 

Data collection was accomplished through several Ute 
programs of the VAX 11/780. All commands entered by the two 
subject's conmanda terminals were sent to separate files in fietiory, 
as was the record of the umpire's game control ternine lle 
process provided a record of ail subject activity: әпс «ош 
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пок сајл ассоџос of all engagements. weapon firirgs and resultant 
Бе а15рт5уеа оп the unpire's terminal for furtrer study. The 
рос was then nanc=-counted to cetermine the number of coimuancs 
Smeereac ana the nuincer of errors corimitted. 

Ш- 200107726! соплепо іс маргапсес rezardirs how (йе number 
EEconmnands entered was actually determined. The гігсгаҒ% launc: 
EDUence 1s wicely used, and is tne most lengtnv and difficult 
cormand. Since the aircraft launch sequence involves at least 
Eu cines to be complete, anc could potentially be aborted 
meewnere within tnose lines, each line of the five that was 


Correctly entered was counted as a conmand entered. 
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У. EXPERIMENT BACKGROUND 


А. INTRODUCTION 

several indepencent factors were considerea Grucial аа 
success of tris experiment. First was the continveéa Ober sae 
Status of tne critical "harcwere" (i.e., tne VAX Cor UC: ти 
HWISS wargere, the VERBEX 3000 system and tne Hacintosh compu 
Secondly, а total of 24 subjects were needed to participete in 
the experinent. Decisions such as the length of esch session, the 
randomness of the Sequences and the combinaticns of scenarios enc 
environrents were also of major importance. This chapter will 
describe the actual training and practice sessions uso 
VERBEX 3000/ħacintosh microcomputer technology,» discus Ина 
background of the subjects, and eléborate on the details SurrcunGcing 


the design of the experiment. 


B. BACKGROUND OF SUBJECTS 

The 24 subjects who participated in the experiment 5 
пугіай ог backgrounds. Twenty-three of them were агп.ес 1888 
officers (i.e., U.S. Navy, U.S. Army, U.S. Air Ғогсе, есе а 
all were studying Command, Control and Communications (C3) 8t 
Naval Postgraduate School (NPS). Nineteen were male ana four were 
female. The twenty-fourth subject was a male civilian computer 
Operator employed at NPS. 

All the students participated in the experiment in conjunction 
with OS 4602, a required Operations Research course titled Command, 


Control and Conmunications Systernris Evaluation. À previous Opera Mo 
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A earch course, OS 3603 (Simulation ana Wargaming), introduced 
the students to the NWISS background and syrbcloay usec for the 
experiment, anG a similar course, OS 3404 (Man-Machine Interaction), 
introduced them to Discrete Automatic Voice Recoanition Theory. 
PENNE tne subjects were familiar with the basic facilities; that 
mene the dicital VT100/102 keyboard terminals and the Eamtek 
craphics monitors. None of the subjects had ever used a continuous 
automatic speech recognition system, anā some haa never usec the 
particular headset-type microphone incorporatea by the VERBEX 
3000 unit. Additionally, out of all the Macintosh players, only 
five had ever used a mouse, and due to the specific nature of the 
software program, it woulc be the first time anyone had played the 
NWISS game using that device. The civilian programmer vas to бе а 
VERBEX 3000 player, апа although he was familiar witk the NWISS 
game, he had never played it usina the continuous voice interface. 

Тһе 24 subjects were diviced into two equal teams cf 12 
people. Each tear would only use one input aevice (either the 
VERBEX 3000 or the Macintosh). Selection was mace randomly, and 
On that basis a VERBEX 3000 player anc a Macintosh flayer were 
partnered so they coulda be scheduled for each session simultane- 
ously. Similar classroom schedules were the only matching prereqg- 
uisite, and although the amount of exposure to the NWISS was 
equal for all subjects, a similar statement could not be made 


concerning each individuals competence with the same. 
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С. ENVIRONMENTAL CONDITIONS 

The experiment was constructed to simulate a militery command 
and control center. To accurately represent this, four different 
environmental concitions vere used. One of four copnbinatgoDn аа 
noise and licht levels was established for each run of the exper- 
iment, and one of four different scenarios was used to allov each 
player to experience a different set of circumstances and environ- 
mental conditions for each individual's wargaming sessions. 
Additionally, by alternating scenarios it helped to preclude 
familiarity, and any possible unfair advantage achievec throuoch 
intimate knowledge of one scenario in particular. 

Noise and light conditions used for the experiment are summarily 
described as follows: low noise (65 db), high noise (85 db), 
normal lighting (approximately 1 foot-lambert) ang low lighting 
(lights completely out; approximately .05 foot-lamnbert) ZEE 
introaquced noise was measured in decibels with an audicmeter 
(on the C-scale), anc readinas were taken at the subject's "еаг- 
level" with the stereo speaker approximately 2-3 feet away. 
Light conditions were measured with a light meter. Normal light 
conditions cf 1 foot-lambert were achieved by maintaining the 
overhead track lights on and directec at a 45 degree angle toward 
the nearest wall. With the lights out in the lew lighting setting 
the only lighting available to the subject was the light emitted 
fron the associated CRT and Ramtek graphics screen. 

To the greatest extent practicable, physical partitions were 


used to maintain the appropriate noise/light conditions throughout 
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each session. Full cocperation was experiencec from the other 
users of the C3 wargaming laboratory, and a stable, controlled’ 
experimental atmosphere maintainec (See Figure 6.1, Chapter VI, 


for a corplete Laboratory Layout). 


D. SCHEDULING OF SESSIONS 

The NWISS experiment took place in the C3 warcaming laboratory 
at the Neval Postgraduate School. It was intended to be run in 
lieu of the subjects scheduled laboratory period fcr their OS 
3603 course. The subjects would participate indivicually in four 
sessions; each run was scheduled to last for 40 minutes. A short 
brief/debrief period would make the entire session approximately 
50 minutes in total length. 

The experiment was conaucted from 15 October 85 throuch 28 
October 85, and during that period a total of 96 sessions were 
recorded, The C3 laboratory proved to be an iceal lccation for 
the experiment. Because the NWISS game 1S reSicgent on the VAX 
11/780, and the VAX, the VERBEX 3000 and the Macintosh computers 
were all located in the same laboratory, they were all easily 
configured anc able to communicate well with each other. 

The experiment was conducted early in the Fall academic 
quarter to alleviate traffic ccngestion throughout the laboratory 
by non-participants. Since the laboratory was divided into three 
equal bays, each player was completely Separated from the other 
player, and in almost total isolation from other laboratory users. 

Actual scheculing was done on a random basis, and chances 
were only made if conflicts arose between team members. The 
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cooperation exhibited by the subjects in this regard миаз’ среза 
appreciatec as only a few last minute changes hac to be mace. See 
Аррепа1х В for a complete listing of subjects, and tne act 


experiment schedule of sessions. [Ref. 16] 


E. SCENARIO/ENVIRONMENT SEQUENCE 

A separate scenario and environmental condition was assicneG 
for each session, ana each team flayea the NWISS uncer all four 
combinations. For example, Team 4 played the NWISS using Scenario 
A and Condition 4, Scenario BP and Condition 3, Scenario C ard 
Condition 2, and finally Scenario D and Condition l. The orcer of 
assigning scenarios was ccunterbalanced for sequential positioning, 
and for both preceding and following treatment effects. (Кет. 
17] (See KEY in Appendix E.) 

The asSigning of environmental conditions was also adjustea 
using the sane methodologdy. The schedule was adhered to as closely 
as possible, and even with three separate last minute session 
chances, all subjects played each scenario anc environmental 


condition once, 


Е. CONSTRAINTS 

Due to its secure environment, and the fact that ell the 
wargaming scenerios vere already available on the VAX corputer, 
the C3 laboratory was the perfect place for running military 
wargames. Nevertheless, certain features inherent to the laboratory 
itself led to the following constraints during the experiment: 


l.  NWISS is the only wargame available at the NPS that has 
the software available to allow the use of the VERPEX 
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FOU пе о Бор the input ӨР усісе сељгљапаз. The 
experiment was therefore constrained to using the VERBEX 
3000 system for the continuous vcice input. 


2% The physical layout of the laboratory itself restricted 
the placenent of the VERBERS 300G and Macintcsh input 
devices to keep a lighted secticn of the laboratory open 
for other student use. 


B. The versatility of the laborétory allows it to be usec 
for a myriad of student/instructor projects. Eecause cf 
this fact the experiment hac to be conducted at a time 
when the laboratory could be exclusively reservea, to 
prevent interference with the established environmental 
conditions. As a result, it was necessary to complete 
the experiment in October. Additionally, the sessicns 
had to be designec to coincide with the regularly scheculea 
laboratory periods of the OS 4602 students in orcer not 
to conflict with their indivicual schedules. The combination 
of all these particulér constraints prudently limited the 
actual sessions to four per subject. Each Session lasted 
approximately 50 minutes to allow sufficient time to 
properly brief the subjects anc collect pertinent Gata. 


4. The subjects were randomly selected, anc permanently 
assignec to only one mode of commana input due to the 
previously mentioned time constraints, as well as to 
increase their personal proficiency with the assigned 
input device. 

С. TRAINING 

E ceneral 

As delineated earlier, all students were assigned to 
either the continuous vcice recognition system (УЕВВЕХ 3000) or 
the Macintosh microcomputer located in the C3 Wargaming Laboratory. 
Each individual was given a thorough briefing on how to use the 
appropriate device, and hov to train the equipment to either 
recognize their unique utterances of the designated NWISS ccrmands 


(for the voice), or enter the necessary  commancs selected from 


the appropriate "drop-down" display window (for the Macintosh). 
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2. Environment Durinc Training Sessions 


Normal laboratory lighting ccnditions were allowed through- 
out the training sessions. This normal level of one tc tvo fcot- 
lamberts would be employed during two of the exreriment's four 
simulated environmental conditions, anc simultaneously racilitatec 
NWISS phraseology reference for the user's refamiliarization/ 
retention. 

A cassette tape supplied continuous background noise at 
a level of sixty-five cecibels. A previous vcice experiment hao 
дебектјпеа а direct correlation between the consistent use of 
this decibel noise setting and the best possible climate for 
voice recognition. [Ref. 18] Besices its acceptance as the best 
noise level for recognition accuracy, it vas discovered that the 
background noise with the presence of a fixed air vent recirculation 
fan would provide the minimum level of noise present thrcuchout 
the course of the experiment. 

S. ЕРЕ 49.00 21 T 

To allow the VERBEX 3000 system to react properly to the 
150 preprogrammed NwISS commanc words, it was necessary for all 
designated voice subjects to engage in two specific phases of 
voice recognition conditioning. The first phase requirea the 
consistent repetitious uttering of all 150 words individually in 
Order to allow the VERBEX 3000 unit to logically associate each 
мога with each users unique voice characteristics, апа then 
physically enroll this "transformed" version of the word into its 


memory for later recall/recognition. This procedure took an 
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averace of 40 minutes for each uSer, and although a stanciarcdizec 
pronounciation of the word was supplied ana encouracea , the 
Subjects were free to substitute any utterance they cesirec for 
the VERBEX 3000 prompt (if it was remenberead апа usec Guring the 
actual waraqaming sessions). In the second phase, a maxirum of 
three of the 150 possible utterances меге concatenatec, ana then 
grouped by Similar usage into nine specific grammars or sections. 
Each partial command phrase was then repeated continuously, ana 
as consistently as possible (using voice inflection and volume 
control simultaneously ) by the user. By design, each utterence 
was repeated approximately 20-23 times in different sets within a 
Specific grammar. It was also recognized that although some of 
the utterances were unique to a specific crammar, cormands such 
as "Control K" were common to all grammars, and therefore trained 
more than the rest. This phase was the most demanding anc repetitive 
in nature, and reauired approximately 5.5 hours to complete. 
Ser. 19] 

At the conclusion of the enrollment and training phases 
each individual received a 30 minute practice session while 
interfacing with ап MNWISS wargaming sample scenario. This was a 
monitored exercise stressing verbal consistency, volume control 
ana refamiliarization with NWISS commands. For a complete listing 
ОЁ all the grammars, the individual procedures involved with 
introducing personnel to the environment and all of the individual 
words that were enrolled, refer to the NWISS/VERBEX 3000 Users 


Guide, Appendix F. 


49 


4, Macintosh Microcomputer Training 

While соггапа input accuracy in the усісе епукгопте ша 
based on repetition coupled with consistency, the point select 
method inherent in Macintosh's mouse requires manual cexterity 
and practicea digit manipulation. To allow the LHacintosh user to 
interface with the wargaming scenario resident on the VAX computer, 
a procram was written in the language BASIC to provice the user 
with command worcs from a limited vocabulary. The program simulates 
the VT100 terminal in that it allows information cormunicatec to 
the VAX to be displayed on the screen for analysis. It permits 
the sequential selection of woras ana limited phrases through an 
appropriate column header and its associatea "drop-down" window; 
all operated ana Selected via mouse techncloay. A capability also 
exists for the user to enter the manual mode andi type соптапа5з to 
the computer using the attached keyboard. 

Training for the Macintcsh was accomplishea in an "offline" 
поде which allowed the user to make full use of all cperational 
corrands, without the response of the VAX computer. Each user was 
given a 15 minute orientation brief on the use of the mouse, and 
the subsequent self-generated training in command selection 


averaged 35-50 minutes. 


Н. PRACTICE SESSIONS 

After training their individual speech patterns the 
subjects were given written instructions on how to bring up the 
NWISS game апа initialize the VERBEX 3000 and MNacintosh 
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microcomputer. They were given a list of approximately 50 separate 
NWISS tasks to perform by issuing commands using vcice anc the mouse 
peripheral input. While the lists were different for the continucus 
ana Macintosh inputs because force names ana call signs were 
different, the general set of tasks were the sane. The tasks were 
very specific in nature to require the subjects to put then into 
acceptable NWISS format, anc then enter the commands as a recog- 
nizable speech cr Macintosh input. 

There were several purposes for the indivicual practice 
sessions described above; especially for the VERBEX 3000 users. 
It helped to identify problems with recoanition (so that subjects 
could retrain vocabulary/refresh their memories), and it was 
useful in teachina subjects to take a general task and convert it 
into NWISS format. This vas especially important for VERBEX 3000 
users in that the necessary pauses between phrases were requiredaà 
for the different grammars. Most users initially thought they 
were having recognition problems, when in fact they were net 
pausing in the proper places. The authors participated in these 
practice sessions (one on the VERBEX 3000 and one on the Macintosh) 
5о that a better feel for the problems encountered by the subjects 
could be experienced first hand. [Ref. 2] 

Enhancement of the experimental design was achieved by using 
ENDUgect training that alloved the identification of "obscure" 
NWISS vocabulary not often trained by the VERBEX 300€ users; or 
inaovertently overlookeó by the Macintosh subjects. There was an 


additional problem with VERBEX 3000 because while an individual 
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word may have been trained, it may not have been ineluded in all 
grammars or phrases. These imposed limitations were téeken 06 
account at the scenario design phase by Wright and Маг шш 
their thesis. and since the sane scenarios were used іг ы 
thesis they were also fully incorporates 
c. ДО Ргасијсе оез5 оне 

All subjects went through a practice NUISS session пе ни 
the actual experimental testing, and (as described in Chapter VI) 
all subjects were assigned to either continuous voice, Масни 
microcomputer or keyboard entry. There were several reasons for 
this practice session. Since all of subjects ћаа recently сом ин 
a separate classroom experiment using NWISS, it was necessary 60 
refamiliarize the voice users with the names of the Тогсеб 
which they had previously trained their voice patterns. їп ааа ШШЕ 
it was found that in the majority of cases (aue Со ТО Шы 
number of students present in each group), all the subjects were 
not able to rotate through the specific position that allowed 
them to actually input commands during the running of tne sess 
This sample scenario gave each individual an inkling of the type 
of commands to be performed during the асоиаі ехрегітеп таты 
subjects had access to status boards snowing their амаш вани 
forces, which made the remembering of names less of problem m 
continued practice. 

The practice sessions proved to be very instructive Pon 
authors during the actual preparation for the experiment ы 


Sample sessions used the actual test experiment format, and the 
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observance of all the groups ina "dry run" inSurea that proceaures 
- used later would be acceptable. It also servec to verify that 
there was ample time to complete the session and aather resultant 
data in the scheduled 50 minute periccds. All environmental conaitions 
were examined, and the correct positioning of stereo speakers anc 
settings on rheostats was noted to insure equal noise anc light 
at both positions. This also servec to insure that the settings 
could be easily duplicated during the actual sessions. 
Ре сепсце of the: Practice Session 

The authors had prepared the laboratory before the subjects 
arrival so that all equipment was turned on, the appropriate 
NWISS scenario was initialized and placed in pause mode ana the 
voice patterns for the intenced VERBEX 3000 user vere lcaced into 
the system. A^ command to save the session was included for post 
analysis to insure that the deSired data was actually being 
collected. 

Before the start of the practice session, the subjects were 
given an administrative briefing about the practice run, anG 
concerning specific instructions for the test sessicns. The exact 
items covered are shovn in Appendix C. Following the aüáministrative 
briefing, the subjects were briefed on the particular practice 
Scenario. Each individual was supplied with a sample list of 
NWISS commands to be used for reference during the session, if 
needed. A verbal briefing on the mission was also given to all 


subjects, and any questions were answered. 
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The NWISS game was allowed to run for epproximately 30 
Minutes. At the completion, the subjects departeG and, if another 
croup was to come in, the authors prepared the laboratory accorad- 
ingly. Acdaitionally, copies of the photcorephea сапе Screams 
were printed at this time. AS waS previously mentionec this 
procecure was only performed for the first fev sessions to verify 
correct information, anc to cetermine how lonc the entire anaiysis 
process would take. Printouts were not necessary for all the 


practice sessions because the баға would not be used in the experiment. 
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УТ. T OF THE EXPERIMENT 


A. INTRODUCTION 
This chapter vill describe the layout ana control of the 
laboratory, the actual conauct of the experiment ana the methoc 


used to record the indiviaqual sessions. 


В. LABORATORY ENVIRONMENT 
1. Configuration 

The NWISS Command and Control laboratory was Giviced into 
two independent bavs (each conficured approximately sixteen 
feet high by eighteen feet in length) and vas used to simulate 
the environment for the experiment. The following equipment for 
each of the two input modes was selectively located in its respective 
section: 


1) a Ramtek graphics screen with a separate stereo speaker 
beside it for procucing background noise, 


2) а УТ100 game status terminal which vas used tc retrieve 
came information only, and 


3) a player terminal (VT102 for the Macintosh or ADN-31 for 
the voice) which allowed commancs to Бе physically enterec 
into the computer. 

Using the ADM-31 as a validation device for character strings 
enroute to the computer, the vcice subjects vere able to monitor 
their inputs, change/cancel incorrect entries and use the Kevhocra 
(on isolated occasions) in the event vcice recognition proved to 
be an insurmountable problem. The laboratory's physical layout 


provided the subjects with easy access to all terminals, anc the 


experiment proctors could evaluate the progress of each session 


55 


uSing the VAX/NWISS control station in the Control Bay: AGa. ee 
equipment was located in each bay, but was separated by a partition 
Cau not directly associated with the experiment itself (see 
ricure 6.1 for a corrilete Labceratory Layout). 
2.  Laboratopy Copntpej 

Personnel traffic was not restrictec during the inciviouai 
voice/Macintcsh practice sessions, but durinec the actua ав 
sessions, access to the laboratory was more restrictive ir nature. 
While the experiment was in progress all personnel were requestec 
to use the rear entrance to preclude the distraction of the 
pneumatic sliding door, ana to prevent uncesirable/uncontrollea 
light from entering the controlled surroundings. Laborétory users 
not involved in the experiment were adviseaq thét use of the 
facility was defaulted to whatever noise ana light environment 
was currently in use during the experiment. Due primarily to this 
precauticnary measure, the environmental conaitions which had 
been adjusted and measured before each run vere acequately 


preserved. 


C. TEST SESSIONS 

The procedure for the actual test sessions was an exact dupli- 
cation of the practice sessions. As before, prior to the arrival 
of the subjects, the proper MWISS scenario was initializea anc 
the vcice patterns for the subjects scheduled were loaced inte 
the machines (see Appendix B). The subjects were briefed in 
accordance with Appendix C and provided with a copy of the applicable 
scenaric for their perusal. Any peculiarities within a given 
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scenario which the subjects woula not normally have experienced 
previously were pointed out, and any cuestions vere answerec. 

Following the briefino, the actual NWISS session began. After 
the subjects went to their positions, the proper noise and lieantuine 
levels were set, anc the cane was stértec. All the Sessions were 
run for forty minutes. Personnel who had repeated aifficulties 
were given assistance as necessary. At the ccnclusion of each 
run, copies of the came sessions were printed out anda annotatec 
for later classification. The forty minute game tine pcinte = 
noted on the printouts, and the number of commands anc "Control K's" 
entered were computed. [Ref. 2] 

While the majority of the experiment sessions were comnpletec 
as planned, some rescheduling was needed due to the absence of 
personnel, or to some unexpectea NWISS came problems. Rescnecauling 
of personnel created no particular problems because each input 
method was usec to play an individual NWISS session, and the 
proper scenario and environmental cecnditions could be reset fer 


any indivicuéel makeup as required. 
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VII. DATA ANALYSIS 


A. INTRODUCTION 

The purpose of this experiment was to evaluate the effectiveness 
of two computer input aevices uncer various environmental conalitions. 
Since а wargame scenaric was usea, the concitions sinulatea 
tactical or Command Information Center (CIC) environments. The 
hypothesis for the experiment was there woula be ne significant 
difference between using the VERBEX 3000, the Hacintcsh or tne 
keyboard systems. As stated earlier, the results were basec on 
the positive lieasure of Effectiveness of comparing the total 
number cf commands entered, and the total number of mistakes made 


while entering the commancs. 


В. DATA SUMMARY 

The number of conmanas entered was dcetermined by surrina the 
"order entered" lines. As previously noted, the only exception 
was the aircraft launch sequence which vas counted as either íour 
or five; depending on whether or not "weapons vere loacec". Tne 
mistakes were determined by summing the applicable Control_k's 
that vere correctly and deliberately enterec. Raw data for tne 
experiment is listed in Appendix E. 

Table 7.1 is the key which deScribes the environmental conaitions 
used in the experiment. It should be used as a reference when 


analyzing the otber accompanying tabies anc figures in this chapter. 
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TABLE 7.1 
ENVIRONMENTAL CONDITIONS 
HOTSE! 


65 Decibels (со) 


LOW 

HIGH - 65 Decibels 
БОЕ 

NORMAL - 1 Foot-lambert 


LOW - .05 Foot-lambert 


Table 7.2 summarizes the mean number of conrmanas enterea, 
based on the variable ncise/light conditions. Figure 7.1 aisplays 


the data rn graphic form, 


TABLE 7.2 
MEAN NUMBER OF COMMANDS ENTERED 


Environmental Condition: Noise/Light 


Input Low Std Low Sta High Ste Hich See 
Device Norm Dev Low Dev Norm Dev Low Dev Куд 
Verbex 599.23 23:4 069,8. ЛЕЕ 15.6 60.7 27,3 74 


PactAGosmn 52852 9,4 43,4 10.0 44,4 16.8 47.2 11.8 ове 


Keyboarc 74,1 15.9 717 МО БШ M 27.8 71.5 19.5 ТА 
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Table 7.3 surrarizes tbe liean Number of Control K's enterec, 
based on the variable noise/light conditions, Fiadaure 7.2 ОБ е 


the Gata in агаве оте 


ТАВЬЕ 7.3 
MEAN NUMBER OF CONTROL K'S ENTERED 


Environmental Condition: Noise/Licht 


Input Low SEC Low Std High Sed high Std 
Device iorm Dev Low Dev Norm. Dev LOW Dev Аус 
Уегрех oS du qu 25 Ou OU Dus 3 4.1 ә 


Macintosh 7.8 a 5.8 2.4 6.2 S UN 4.2 6.29 


Keyboarc 946 4.3 n 2.09 7216 3.6 3 6.4 7.0 


Table 7.4 summarizes the Mean Number of Commands enterea basea 


on the trial number. Figure 7.3 даісвріаув Еһе ааҒа іп старпіс ГС 
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Table 7.5 summarizes 


based on the Triel 
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Figure 7.4 displays the data in graphic 
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С. STATISTICAL METHODS 

Once the data from the experiment was complled, two-way analysis 
of variance techniques helrec evaluate the results. Two statistical 
Enatysis software programs resident in the IEM 3033 mainfrérie 
computer were usec to facilitate the calculations. The first was 
MINITAB, and the second was the Statistical Analysis System 
(SAS). 

In testing analysis of variance the following two assumptions 
nust be made: 1) the populations from which the samples care can 
be approximated clcsely with normal distributions, and 2) they 
all have the sane variance. [Ref. 20] For each case, the hypothesis 
was tested at a confidence level of 95 percent. Acdaitionally, for 
each environmental condition (i.e., ncise/liaht level), a ratio of 
the number of errors that can be expected per the number of valic 
commands entered was calculateo. This was computec for each of 
the three input devices. Finally, an analysis using SAS was 
conductec as a backup for some of the data that was analyzed 


using the MINITAB program. [Ref. 21] 


D. ANALYSIS 
1. Introouction 
As with the statistical analysis, it is Gesirable to use 
aS Many data samples as possible. Since it was difficult to 
conmit a large number of subjects to the experiment, each of the 
Bemoub jects participated in four separate sessions, thereby 


Petaling 96 samples (VERBEX 3000 and Macintosh). Again, the 
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кеубоака даба was that which was compiled fron the Wright/Manson 
experirent. 

IC was now important to ensure that the scenarios were 
variea enouch to be an "indepenaent session" for the subjects, so 
that no unfair acvantage would cccur during a tri:al run Ша 
two-way analysis of variance was obtained between the nurber of 
commands enterea and the different Scenarios useo. Also, a tvo-vay 
analysis was conducted between the number of Control K's enterec 
ana the gcifferent scenarios used. The result vas the same for 
each, which indicated that neither one exhibited any sionificant 
Gifference. It is therefore reasonable to assume that the experiment 
consisted of 96 individual sessions. The Wright/Manson experiment 
consiste of 13 keyboard operators vho also playec the icGentical 
set of 4 aifferent scenarios (totalling 52). The corbined total 
is then 148 sessions (samples) for this experiment. 

2. Best Environment for Each Input Method 

It was expected that each input device would ао better 
under a specific combination of environmental conaitions. For two 
of three devices the results also showed that the combination 
that provided the greatest number of valid commands to be entered, 
also provided the fewest number of errors (i.e., Control K's). 
This is a desired situation and is reasonably intuitive. What 
follows is a brief description of the best environment founc for 
each particular input method. See Figure 7.5 for a listing o SEHE 


ratios (errors per valid commands) for each device. 
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VERBEX MACINTOSH KEYBOARD 
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Figure 7.5 Ratio of Expected Errors Per Valid 
Command Under the Environmental 
Conditions Specified 
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For the VERBEX 36000 systen the greatest number of valic 
cormanáGs were erterea under a low noise, low light conaition. 
Concurrently, the fewest errors were entered uncer these exact 
concitions. Based on the F ratios calculatec after perit ormi om и 
two-way analysis of variance (at the 95 percent level), спешешв 
NO significant difference between the number of cormands enterea 
ana the environmental conditions. The заге result was realizea 
(NO significant difference) between the number cf Controi K's 
(errors inputed) and the environmental conaitions. That 1s, 
although there is a "lowest ratio" for the VERBEX 3000 system, 
there is NO sicnificant difference between the number of commancs 
entered or errors entered, and the environmental conaitions under 
which it was used. AS expected, the lowest ratio (errors per 
valid commana entries) came under the same lew noise, low light 
condition. (See Appendix E for actual Statistical Базар 

For the keyboard system, the highest number of valia 
согпапаѕ меге entered uncer two conditions: 1) lcw noise and 
normal lighting, and 2) low noise anc low lighting. Here again, 
the fewest number of errors were made uncer low noise anc normal 
lighting conditions. Like the VERBEX 3000, tne F ratio calculatea 
from the two-way analysis of variance revealed NO significant 
Gifference between the nurber cf commancs entered (and the number 
of Control K's enterec) and the environmental condition. Never- 
theless, the lowest ratio occurred under a low noise, normal 


lighting condition. 
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For the Hacintosn, the highest number of valid commands 
Meee entered under kigh noise, low lighting conditions. Tne 
fewest number of errors were entered under low noise, lcw lignt 
Editions. Аз with the previous input devices, NO significant 
difference was revealed between the number of cormnrands entereG 
(or the number of errors entered) and the environmental condition 
used. Here, the lowest ratio occurred while operating under low 
Ec and low lighting conditions. 

EE best input Method for Each Environment 

This question was answered using г two-way analysis of 
Variance. Each environmental condition (i.e.» noise/light) should 
reveal a desired input device which yields the largest number of 
commands, and also the fewest number of errors. As in the previous 
question, the ratio of errors to valid commands also revealed 
some practical insight into which device may be preferable when 
с а particular noise/light condition. The two hypotheses 
stated that the number of commands entered (and the number of 
Control K's committed) would be equal for all three input devices. 

Conclusive results (based on the F ratio at 95 percent) 
Show there IS a significant difference between the number of 
Emnmands entered and the input devices. In all four noise/light 
conditions the keyboard operators entered more commands than all 
the other subjects. This was not the case, however, when a measure- 
ment of the number of Control_K's conmitted was taken. Here, the 
two-way analysis of variance revealed no significant difference 


among any noise/light condition and the input devices. Even on 


T1 


~ 


examining the raw data it was shown that NO clear гачапЕссе 
existec for any particular device. The calculateo ratios (see 
Figure 7.5) aisclayed the followinc acvantaces uncer each environ- 
mental condition: 


BEST INPUT METHOD 


1. Low Moise / Normal Eughteec LLL KEYBOARD 

2. Low Noise / Low опет oe VERBEX 

3. High Noise / Normal Раоа = па и KEYEOARD 

4. High Noise / Low Іі: -------------- VERBEX 
4. Best Overall] Input Method 


This cuestion was answered using a cne-way analysis of 
variance. The F ratio was again calculated &t a 95 percent confidence 
interval, and the hypotheses were the same as the ones cescribec 
in the previous question. 

The results revealed a significant difference between the 
mean number of commancs entered and the input cevices, thereby 
rejecting the null hypothesis. The raw data showed that the 
keyboard operators entered more commands than the operators of 
the other devices. The VERBEX 3000 players were only slightly 
lower, while the Macintosh players entered an average of 43 
rercent fewer commands per seSSion. 

As far as the number of errors committed was concerneo, 
the one-way analysis of variance showed NO significant oifference; 


thereby accepting the null hypothesis that the number of Control_K's 
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entered by all three input cevices waS equal. The raw data showea 
ШОГУ a difference Of 2 or 3 errors amongst input devices per each 
session. Тре УЕЕБЕХ 3000 haa the fewest (an averace of 5.6), next 
КО е Macintosh (with 6.9), and finally the keyboarca (with 5.1). 

It was interesting to note that NO sicnificant learning 
curve took place between the subjects when consicerina either 
the number of commands entered, or the number cf Control K's 
committed. It is worth mentionino, however, that the Hacintcsh 
Subjects increasec the number of commands enterec for each succeeaing 
trial (session). This can be seen Graphically depicted in Fissure 
7.3. The reverse was not the same for the number of Control_K's 
that the subjects entered, and acain, neither was it sianificant 


(this can be seen graphically in Figure 7.4). 


Е. SUMMARY 

To summarize, there were few significant results. Even with 
the aacea benefit of looking at the raw Gata, not all the questions 
were anSwerec unequivocally. None of the three input aevices 
coulc be labeled as a clear-cut winner over any of the other 
Gevices. Each of the devices performed best given a specific set 
Of environmental conditions. Oddly encugh, the VERBEX 3000 and 
Macintosh both performed best in the Low Noise/Low Light conditicns, 
and the keyboard performed the best in the Hioh Noise/Normal 
Licht conditions. Without recard to the Noise/Light conditions, 
the VERBEX 3000 system had the lowest ratio (i.e., error to ccormana), 
with the keyboard a close second (.102 to .112 resrectively). The 


p 


Macintosh entered fewer conrands than the otkers, ana was гапкес 
second when measuring the numbers of errors committed. Additionally, 
no significant learninc took place auring the four БОРЫ 


sessions that each indivicual participated in during thecexper M 
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VIII. CONCLUSIONS AND RECOMMENDATIONS 


A. INTRODUCTION 

The objective of this thesis was to evaluate cifferent input 
interfaces to the MWISS wargaming scenarios resiacent on the VAs 
11/780 computer. The two hypotheses were that the mean nurber cf 
commands entered ana the mean number of errors committed (using 
any of the three tested input devices) woula be equivalent. While 
the objectives of the thesis vere successfully established on the 
completion of the experiment, no single input сеуісе сап be 


Gesignated as the "better" of the three. 


B. CONCLUSIONS 

Before the experiment, the authors of this thesis anticirated 
that the vcice system would outperform the other сеуісеѕ. Ву the 
term "outperform", it is meant that the VERBEXA 3000 subjects 
would enter significantly more commanas and commit fewer overall 
errors than the other cGevices. It waS expecteac that the Macintosh 
woulc outperform the keyboard simply by virtue of its current 
technology. In general, the analysis of the Gata dig not confirm 
these expected outcomes. 

Many reasons can be given to explain these unexpected results. 
As far as the keyboard was cconcernea, most of the subjects маѕіес 
little time in moving their keyboards as close as possible to 
their aata input (CRT) screen in the low light condition. Using 
the vieo screens inherent alcw helped considerably in locating 


the correct keys; especially for the non-typists. Also, a post 
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experiment survey revealea that the keyboarc operators were 
experienced typists by and large. By this it is meant Спа E 
worst most of the subjects were able to use both hancs whi Poeem 
occasionally lcoking at the keys. Bv inplication, military Ош 
postcraduate students are collectively more likely to песи 
typing experience (i.e., used typing skills Guring their lengthy 
eGucation/training) than the general population. Their eaverace 
lifetime exposure to keyboarc technology is hich, ana again this 
particular croup was above the norm. [Ref. 2] On the other 
hana, none of the subjects hac prior experience with either the 
continuous vcice system, and only a few subjects hag prior experience 
with the Macintosh microcomputer system. This brings into focus 
the implications of the necessary training involvec for each 
device. The VERBEX 3000 subjects trained with the voice system an 
average of s1x hours only one week before the experiment. Considering 
that it takes years of frequent typing to become proficient, the 
VERBEX 3000 subjects did vell to keep up with the keyboeéra operators. 
The Macintosh subjects practicec for about 35 minutes сайы 
concentrating totally on developing the motor skills necessary to 
maneuver the arrow using the mouse peripheral. In retrospect, it 
is felt that they would have performed considerakly better if 
they had been as proficient (through additional training) и 
use of the mouse as the keyboarac subjects were in using their 
acquired typing skills. Тһе гам data from the Macintosh players 
shoved a slight increase іп the mean number of commanas entered 


for each individuals' succeeding trial. Although it was not a 
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Slonificant increase, the Same statement could not be пасе Гог 
the other devices. 

ва looking at the ratios (see Figure 7.5), each cevice 
performea vell Mnicermeertain nolse/iilant conditicns. The VERBEZ 
ООО епа the Macintosh hac the lowest error to ccrmand rétio 
meer the lov noise/l1cw light conditions. Not surprisingly, the 
keyboard operators hac the lowest ratio under the high noise/normal 
light conditions. For the keyboarc and VERBEX operators, each haa 
the lowest error to commanc ratio in two of the four envircnmental 
conditions. Looking specifically at the "light conditions” (without 
regard to noise), the VERBEX 3000 system hac a lower ratio than 
the other cevices. Similarly, the keyboard uSers attained their 
lowest ratio under "normal light concitions". Considering the 
inexperience of the VERBEX 3000 operators, they cia extremely 
well in the most likely high stress, wartime environment (high 
noise, low light). The error to command ratio was .015 lower than 
the second best, keyboard. 

Although we can logically conclude that the keyboard aic 
perform better than the other Gevices, it would be illogical to 
conclude that the other input aGevices do not warrant further 
pesearch. Just lookinc specifically at noise conditions (without 
regard to the lights) the VERBEX 3000 system hac a lower ratio 
than the other devices. Consicering the inexperience of the 
УЕКВЕХ 3000 operators, their ratio was only .004 higher than the 
keyboard subjects in the nost likely high stress wartime environment 


Meme Of high noise and low light conditions). 
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Another area analyzed was tlie presence of any learning Croome 
the subjects nay have received from previous sessions. honte 
the subjects performed significantly better over the four Cras 
While this was not necessarily an encouraging trend; сега невин 
supports the independence of each session, thereby mea: mr спе 
sample size of the experiment Itse тере ие 

One final comment should be made about the likelihood that 
inexperienced operators will often be at the controls of the 
input media in an acadeniic or training envircnment. For examples 
a senior officer (i.e.» 0-5 or above) attending the Нат Шан 
College will play similar war games. It is highly unlikely that 
an individual will have had prior experience using speech or 
"menu-oriented" systems for input communication. It can therefore 
be concluded that with a minimum of introduction to these devices; 
almost equal performance can be attained to that cf the experienced 
typist if the syntax required of the game commands is also well 


learned by the novice user. 


С. RECOMMENDATIONS 

It is the opinion of the authors that further study 1S JUS Gage 
concerning the potential of the three input devices. БЕЙ 
another experiment is performed, however, it is recommended that 
sufficient training of the subjects be conducted. lt маз ы 
that the Macintosh subjects would have performec вірпігісашш 
better with more extensive training and dedicated practice sess ии 
This would have enabled them to become more familiar with tne 
coordination required to effectively maneuver the cursor мова 
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ШО е те сгоБ1ем м1 ЕЁ this proposal is tbe time constraint 
irnposea on both the planning and execution of the exveriment. 
Optimally, all subjects should Бе equally skillea in the use of 
Ehe particular input cevice. 

Additicnally, the software interface program for the tiacintosi: 
EDUC be rodified to facilitate a quick, efficient anë accurate 
mode of input for the user. This modification woula require a 
more natural arrangement of commands to allow an easier interaction 
with the sequence of these commands required by the syntax desian 
of the software. 

Acquisition costs for these Gevices and any study of cost/benefit 
relationships would provide additional fertile grouna for future 
research. Current downward trends in haraware costs, ana a cenerél 
lowering of costs for all technologies which are driven by micre- 
computer advances in the marketplace, cause a "concept cf costs" 
for these systems to be well worth considerétion. 

NWISS shoula be used as a medium for any further experimentaéticn. 
The necessary peripherals are all established, and it provides an 
accurate Simulation of a real-time environment.  Varying environ- 
mental conditions are easily simulated in the C3 laboratory, andi 
the accessibility limitaticn makes it an ideal rlace to conduct 
further experiments. 

In conciusion, future experiments shoulaà include the previously 
ENested modification to the Macintosh software and the most 
advanced “touch screen" and voice technology available. It is 
felt that these three devices have the greatest potential to meet 


the requirements for an efficient input medium. 
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D. SUMMARY 

man's zeal to accomplish the ideal “"Ппап-пасһіпе” ітсеггеети 
has allowed significant procress to cccur гесага1по 1приё cevices. 
The keyboard was first, ana has been cepencable but restrictive; 
sometines to the point of being inconvenient. CGCuick to approach 
popularity were several "non-traditicnal" methods; one being the 
voice system. The discrete vcice system iS unnatural and Пека to 
use for most users, while the continuous system 1S easier to use 
and more convenient for the jobs reguirinc user input and manual 
labor simultanecusly. Two other methods are the "pull-down" menu 
anc the "touch screen" technologies. Both have been successful 
even in their early stages of cevelcpment. 

Man is quickly approaching the doorstep of Fifth Generation 
computer technology. Therein lie "intelligent systems" which will 
Give increasing flexibility to input devices of the ftture. 
Unfortunately, there can be no "perfect" universal input method 
due primarily to the vaeriec requirements and restrictions innate 
to each individual job. Nevertheless, it follows that continued 
research shoula be aimed at producing a body of knowlecce лен 
would allow us to pick the best method of computer interaction in 
a specific environment. Although it is recognizec that сопрш и 
speeas today are restricted from full use because of the slcwness 
of interface hardware, the rate of progress in ceveloping high 
speed CPUS 1S compounding the problem. Therein lies the impetus 


to continue toward the cevelopment of better input media. 
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APPENA А 


SCENARIO BRIEFINGS 


SCENARIO A 


SITUATICN: Hostilities have alreaay been declarea, ang Orange 
forces ere providing escort for a large convoy of caro skips 
carrying nuclear/chemical weapons. 

FRIERDLY FORCES: You have available one Aircraft Carrier, 2 Knox 
class destroyers, a Los Angeles class submarine (positioned north 
Пе сопуоу) апа 2 flights of 4 P3C aircraft. 

ENEMY FORCES: Orange forces have 8 ships escorting 10 merchant 
ships in the convoy. No air assets are presently availakle, or 
expected. 

MISSION: Destroy all Orange combatants without inflicting aarage 
to any cargo vessels (due to the nature of their carao). 

МОЕ: POSITIVE 


-- number of weapons Ғігес амгіпа the Session 


-- number of combatants identified, hit апа damacec/sunk 


NEGATIVE 


-- number of merchant ships hit/sunk 
-- number of Elue Aircraft lost 


-- number of Blue vessels hit/sunk 


XI 


ӘСЕГАКТЕЙЕ 
SITUATICE: Approximately 20 Orence rercbant vessels are тапса 
in port waitinc to unloac various cargo. Hostilities are irpoc 
FRIENDLY FCRCES: Blue forces include 2 P3C aircratt CDM 
crcuüps of 5 A6E's. An aircraft carrier is available tomm 


further air assets if ceemed necessary. 


ENEMY FORCES: Location and makeup of Orange forces is undetermined 
cue to poor weather/intelligence. 


MISSION: Destroy as many merchant ships as possible, anc attack 
combatants only 1f fired upon. 


МОЕ: РОЗЕ 


-- number of weapons firea 
-- number of merchant ships icentifiec, hit ana damagec 


-- number of combatants icentifiec, hit end damaged 


NEGATIVE 


-- number of Blue forces Gamaced/lost 


-- nurber of merchant ships remaining 
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SCENARIO- C 


ON: There are confirmed reports tnat large nurbers of 
Orange Corbatant units heve left port, are runninc EEKCON silent 
аге uniocaetable at this time. There are friendiy/nevtral 
forces in the neighboring area anc tensicn is rising. No hostilities 
have been dGeclarec as yet. 

ШИЕТПШТІҮ FORCES: 1 P3C aircreft and 4 FI4A aircraft are available. 
Other assets are in the area, but are not uncer your airect 
control. Any merchant ships enccunterec are not to be consiaerec 
hostile. 

MESSION: Search for possible contacts in the area from 35N to 
42N, and from 174E to 180E (ог 164Е ёо 1702 серепајпа or the 
oceanic aisplacenment). Locate, identify anc aeSignate as many 
vessels as possible as either enemy, friencly or neutral. Center 


the plot upen the P3C at the start of the session, ance weapons 
will remain tight unless fired upon. 


MOE: POSITIVE 


-- number of Orange forces properly iaentifieG 
-- number of Blue forces properly identifiec 


-- number of Neutral forces properly identifiec 


NEGATIVE 


-- mumber of forces improperly designated 


-- mumber of forces remaining not found/properly cesignated 
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SCE AR a 


SITUATION: An Orange SAC is 100 NPM Girectly north of your розш и 
and you are tasked to intercept anc visually identify it. Hostilities 
have not been ceclared as yet, but ere exrectec to break out scon. 


FRIENDLY FORCES: Cne Aircraft Carrier (with its associate airc roo ioii 
3 escort ships ana a submarine. 


ENEMY FORCES: The strength of the Orange forces is unknown, but 
they are not expectec to nave any aircraft launched at this tine. 


MISSION: Launch carrier baSea assets to search/icentify the 


suspected Orange SAC. All weapons will remain tight unless firec 
џропе 


МОЕ: POSITIVE 


-- number of aircraft successfully launched 
-- number of enemy assets properly identifiea 


-- number cf enemy assets daamagec (only if fired upon) 


NEGATIVE 


~~ number of Orange forces not cesignated as eneny 
e-cmumber or Elue өліге Hit, hese 


-—- number of Blue aircraft lost 


АЕ 


EXPERIMENT TEAM MEMBERSHIP/SCHEDULE 


а a a tga ie A ror A E 


Team Verbex Macintosh 
| Findlay Caldwell 
2 Gahagan ШОШ ГОС 
B Pratech Stone 
Д Gree v0 Wicks 
5 Goyden Alecxin 
6 Herkert Moreau 
Т Kotowski Kennedy 
б Comic ro McLaughlin 
9 Thoripson Теке) 

10 Buettner еми 
11 БІНЕ Wall 
12 Осајп Gruetzner 


EXPERIMENT SCHEDULE 
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АРРЕПВ И? 


SUBJECT ADMINISTRATIVE BRIEFING 


NOTE: The following administrative briefing was initially а 
to each subject prior te the beginning of the experiment. кеу 
roints were re-emphasized at each sessicn as applicable. 
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The sessicns would be approximately 50 minutes in length, each 
subject would be scheduled for four individual sessions and а 
master schedule of all sessions vas posted on CDR. эсери 
office door for reference, and to facilitate changes throughout 
the experiment. 


Subjects were asked to wait outside the laboratory until told 
to enter. This precaution was taken in order to preclude an 
inadvertent disturbance in the environment if a previous group 
session was Still in progress. 


The voice patterns for the scheduled VERBEX 3000 subject were 
already loaded to avoid any unnecessary delay. The user simply 
had to set the gain in orcer to be ready to start the Sesso 


The noise/light conditions for the particular session Tenk 
explained and set. 


The subject was provided with the scenario for the sessicn 
and all key points were verbally emphasized. 


All subjects were advised to ask for help during the sessicn 
if any problenis were encountered. 


The subjects were asked not to discuss any of the scenarios 
following their sessions until the experiment was completed. 


Each group was reminded of their next scheduled laboratory 
period following the completion of a session. 
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APPENDIX D 


EXAMPLES OF COMMAND SEQUENCES 


ШЕШ - сјау ... Кааји5 2 5 0" 
- "Execute BAIRASW" 
- "Execute FlASTRCAP" 
НИКОГ КаЕбБУ ... Launch ... 2 A7E A6E ...(course) 2 3 5... (speec) 
E30 ... (altitude) 15 0 0" 
Flt. Plan: "Mission Strike" 
 еРРЕЛаП: Proceed position ... 4 5 N... 115-2 0 E" 
ШЕР: PTan: Load 2... (equipment) 3 Shrik ... 6 HK82" 
ВЕ. Plan: "Stop" 
ШІ гесбіспагсе Епељу ... (track) ЕЕ 005" 
eee bisplay ... Place Circle Force ... M P615 (radius) 5 0 " 


- "For V AO 10 ...Weapons Free Eneny A11" 


END: H2 00 ... Barrier ...(posit3on) 15-200 N... 125 
ЖЕИШЕГЕ ... (Dearing) 1 3 5 ... (distance) 4 5 ... (usinc) 
ВО б 2 ... (spacing) 4" 


NOTE: Words in (parenthesis) are pronpts that appear on the 
Speech unit. 
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APP Ein ВЕ 


INDIVIDUAL DATA 


Environmental Conci ton 








1 = Low Noise, llormal Light: 2 = Low Noises) Eaves 
3 = High Псоізе, Џогтај Light; 4 s Eigh Horse POM MM 
ара Env 
Tean Device Scenaric Condition Cmds Сепсгог К | и 

1 Verbex A 1 50 6 1 
В 2 76 a 2 
о Ц 63 ҮЗІ 3 
[) 3 96 © 4 
Macintosh A 1 27 Т) 1 
В 2 56 11 2 
C Ц 26 Ц 3 
D E 36 9 ц 
2 Verbex A Ц СБ 16 1 
В 1 78 34 2 
С 2 E 3 3 
D 5 = 1 L 
МасігіозҺ А 2 52 & 3 
В 4 50 2 Ц 
С 3 55 б 2 
[) 1 38 11 1 
3 Verbex A 2 64 С 1 
В 1 67 10 2 
e 3 36 12 3 
[) 4 36 5 ~ 
аса Сов А 2 ЭШ Э 1 
р 1 20 Tes e 
C В EU 11 E 
D Ц 49 155 4 
4 Verbex А 4 4 2 T 4 
B 3 ЦИ 1 З 
С 2 62 3 = 
[) 1 2 4 1 
Hac intosh А Ц Ti Т Ц 
В 3 54 5 3 
С 2 2 T 2 
D 1 24 E 1 
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APPENDIX Е 


NWISS/VERBEX 3000 USERS GUIDE 
moa RODUCTION: 


This users guice was prepared to facilitate cognizant indivicuals 
in training their individual speech patterns to the Verbex 3000 
voice terminal. The unit has a maximum vocabulary capacity for 
360 words/utterances, 150 of which will be trained in orcer tec 
interface wargaming scenarios resiaent on the VAX 11/780 ccmputer. 


The guide is diviaec into the two (2) separete sections that 
are representative of each actual phase of traininc. The first 
phase is ENROLLMENT, which allows each word/utterance to be 
individually and repeetecly spoken. The second phase is TRAINING, 
which incorporates the repeatea use of the phraseolcay necessary 
for wargame scenario interaction. 


What follows is a list of Specific procedures used to enable 
the sytem for both the ENROLLMENT and TRAINING phases of the 
voice experiment: 


l. The machines (Verbex, ADM 31, VT-102, ana the speech unit) are 
connected using the proper adapter as shovn in Ficure #l. (Figure 
*2 shows the configuration to run NWISS on the VERBEX 3000). 
ШИЕ small machine to the right of the VT-102 has "VERBEX 
3000" printed on the top, and will hereafter be referrec tc 
as the "Speech Unit", so as to not be confused with the larce 
VERBEX 3000 unit located just to the left of the table. The 
following specific procedures should be utilized to effect 
|]roper set-up: 


А. Turn the ADM 31, VERBEX, and VT-102 to the power-on position 
(see Figure #1).NOTE: Turnins the ADM 31 on is optional 
for both phases. 


ES The Vf-102 ana the speech unit will automatically run 
through a self-test (using the alphabet). Орсп comrleticn 
of this procedure, the speech unit will read: " Booting 
VERBEX 3006 ". NOTE: The VT-102 screen will be a scranmblec/ 
garbled alphabet on occasion; this is still considerec to 
be normal operation and will not effect the follcw-on 
VERBEX enrollment/training phases. 


Ө 


D. 


E. 


Mow complete the following steps to enable the systen: 
1. Press the SET-UP key on tne Сен 
2. Press the Set Up А/В (#5) key --- to set-up "B", 


J. Press the Transmit Speed ($7) key --- press sPecOM MN 
repeatecly to scroll to 4800. 


4. Press the Receive Speed (#8) key --- press slowly ana 
repeatealy to scroll to 4800, 


5. Press the SET-UP key to exit. 


Eit the RETURN KEY (of VT-102) --- this will move the 
cursor to the left Side or Ее есу са 


With the cursor on the left sice of the (VT-102) screen enter 


tne following commands sequentially, and wait for the 
computer to respond (as shown in the output cclumn) 
between entries: 


ENTER QUTPUT 
dir <return> Girectory listing 
ed .asd to use the edit .asd file 
n to number lines 
р to print lines 


If NWISS :w:/NWISS is on line 1: Enter " x ", and continue 
with step letter I. 


If NWISS :w:/NWISS is not on line l, enter: 


1. 2m0 (assuming it is on line two) 


2. ров 
2. ( this saves the new order ) 
The pronpt on tbe VT-102 should be " - " (a dash). 
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E SEN а" —" as a prompt, enter:  nviss/nwiss 
J. The screen shoulc reac: 

Monitor: Version 2.0 

СОЮШ спе (Е) 1995, Exxon Core. 

АОН = Сга$р 3.1 


and the speech unit will read: " Enter user Ір = ", 


2. Fron the speech unit enter " 00 ", then press the enter key. 

This will open the supervisor moce. (NOTE: the Enter Key must be 
pressed after each entry from the key pad on the speech unit). If 
you realize you have selectec an incorrect number for input prior 
o pressing " ENTER "“", you may press " CLR " (the bottom right 
key on the VERBEX keyboarc) anda then press the correct number to 
be reentered. The " Please Wait " light will illuminate, ana 
after a minute or two the speech unit will геас: "Аас Kev User?", 


3. You will now begin to scroll through Menu #1 (See Menu Listings). 
Press the NO button to scroll through the Menu for familiarization 
purposes. 


4. To begin the ENROLLMENT phase (approx. 20 min.) Fress YES 
when the menu reads "Аса New User?". 


5. The speech unit will nov read "Enter New User ID =". Enter 
your user number and press ENTER. NOTE: Be sure not to enter e 
number already on the enclosec list of used nunbers.(see MENU 
GUIDE). 


6. Put the Headset on with the Mike on the left side (see Figure 
НИ Mike POSITION IS CRITICAL !! Position the Mike only a 
little to the left of center, and slightly lower than the center 
of the mouth. It should be no more than 1/2 inch (i.e. about one 
thumbswidth) from the lips without touching them. Pericdically 
check the microphone for proper placement in order to insure 
consistency. 


7. When the microphone is in place and you are ready, start the 
amplifier and the tape deck in Bay #2 (in orGer to interject 
crowd noise at 65 db into the training), using instructicns 
attached to the tape ceck itself. 


8. The speech unit will prompt you to "SET the GAIN". 
It will read "Gain Now at 1, Yes to Set Gain". 


(NOTE: A gain of 1-3 is OK -- under normal voice levels, а 
gain of 2 - 3 will be maintainec ). 
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ч 


10, 


When ready to proceed, press the YES button and perform the 
following steps: 


А, Follow pronrt (ie. say "One, tvo, сле оне 
testing... 

Eee The speech unit will now reaa: "Gain is set to (1-4), 
YEG (tor set салт NN 

С. Press themes button. 

D. Follow the prompts as before. 

Е. The Speech unit will now read: "Gain 15 set to 3, ҮЕБ РЕ 
set gain". 

E. -Press stne’ YES sbuccon. 

er Eventually the speech unit will rea: "YES СО бай 
backround ncise". 

He Press tbe YES button, 

I. The speech unit will now read: "Remain Silent”. At this 
point do not make any adaitional noise other than normal 
breathing (lasts about 2-3 seconds). 

J. The speech unit will read: "Yes to sample silence", 

К. Press the YES button. 

L. The speech unit will now read: "Remain Silent". Again, 
ас поё make anv additional noise while it is sampling the 
Silence cf the environment. 

м. The speech unit will now read: "Gain = (1-4). YES to 
proceed", 

NOTE: 

А. If the gain is 1-3, do not press YES until you are геасу 


to proceed with the exercise. Be aware that the STOF button 
can be used at anytime throughout the training cycle for 
one of three (3) possible reasons: 


1. If you would just like to take a break for a few minutes, 
press the STOP button and you will be promptec to 
"Continue Training?”. Simply press YES when yous. 
ready to continue, 
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ОО ОООО е касе 2 гісЕаце on ап utterance, press the 
СОО ОРОКТОП, Осе Се NMO Dutton to scroll through tre 
перо ey Until you reac “Reject Last Utterance?". 
ЕЕ Ее YESwotELton wilt accept tEnat command anc: 
immeciately continue with the next word or pnrase. 


B. If you feel what you have done is corpletely unsal- 
шо ое с го Іс poornt,press STOP. Scroll türcuch 
the menu (#2) until you reac "“Logout?". Press YES, 
and if you are in the EMROLLEENT phase, continue with 
Step £2. If you are in tbe TRAINING phase, continue 
with Step $ 13 a. 


ТЕ: 


Get comfortable before you start. Take breaks if you need them, 
ana Strive to be consistent with your voice modulation. See 
Enclosure # 1 for a complete list of the words you will see 
throughout the session. The words will be in crder of appearance, 
ana the "less than obvious" annunciations will be annotated for 
Standaraization purposes. 


If the gain = 4, it is best to start égain. Опе way to ао this is 
to continue as normal until the actual cycle nas startea ргопріёіпс 
you with the first wora of the session. At this point press the 
STOP button and scroll through the menu until you read "Locout?", 
LEN YES. Tbe speech unit will read: "Exit (your ІС +)", апа 
will then read: "Logout Supervisor", fcllowed by: “Enter User 
IL", Continue from Step #2 using your same initial ID number when 
responding to the "Add New User?" prompt. 


11. Upon completion of the enrollment phase you will see "Enrollrent 
Done. YES to Save”. Push the YES button and wait for the "Patterns 
Saved. YES to Train" prompt to appear. Now push the follcwing 
buttons in the sequence below: 

meee Push the STCP button. 

В. "Resume Enrollment?"; press the NO button. 

C. "Reject Last Utterance?"; press the NO button. 

D. "Save Patterns?"; press the NO button. 


fee појош 2 ; рке5з5 the YES button. 


12. This concludes the ENROLLMENT phase of the individual voice 
training cycle. 
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13. The next phase is TRAINING and it includes ten (10) aifferent 
sections. You will be аѕкеа to train different согртпа нон 
of the wors you usea in the ENROLLHERT phase. The nanes anG 
approximate "time to complete" are listea below: 


A. 


В. 


Cs 


D. 


Е. 


ТОВ: 20 mime бы ы Е : l7 i2 
FORGE 2 27 ШӨП 7. SHIEOBDDDME 24 таи 
DISPLAY : 16) тоу 5. АТВОВОЕЕ ШЕ 31 ming 
РОБ ЕВО : o min, 9. DIGITS : 9 ming 

TRACK : 7 min. 10. LAUNCH : 32 Wie 


NOTE: You may do these in any order. 


The following procedures should be adhereG to for each section of 
the TRAINING phase: 


A. 


В. 


Е. 


КОТЕ: 


Е 


When the speech unit reads: "Enter user ID", you vill 
enter: "00". This procedure logs on the "supervisor", 


The speech unit will then reac "Add New User?” (as part of 
пепи #1). 


Scroll through the menu with the NC button. Stop эсго ИШ 
at? “Retrain Cla User s. 


Press YES. You will now be prompted for your ID 
number. Enter the same number as before. The speech unit 
will now rea: "Loacine Patterns for user ID (vour IPEA 


After a minute or so, the speech unit will reac: “ATI 
Grammars?". Always respond by pressing the NO button. 


If you press YES, you will be asking for a long exercise. 


The speech unit will reac a menu (#4) of all ten (10) 
selections. Scroll thrcugh it with the NO button SOT eon 
you find a section you wish to train. 


When you find it, press the YES button. 


The speech unit will prompt you to Set the Gain. Do 
this exactly as before (Step # 8). Bemember, be reacy to 
Start speaking inmeaiately after pressing the YES button 
in response to the "YES to proceed" prompt. Examples of 
worc corbinations are listed in Enclosures (2). 
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i К = eE О аи Таз  уоп will be able to use 
the STOP button for the sane reasons as stated in 
Step ғ10. 


INE 5 tie Con tletion Of each of ере ten (10) treininc sections, 
the speech unit will reac: "YES to seve”. 


Қ. Press the YES button. 


р, The speech unit will now read: "Patterns Savec. YES 
to Test". 


Pee Press the YES button. 


** NOTE ** Test Sessions: 


l. For each completed and saved training section (excert 
"CISPLAY"), you will be promptec to sey cne vora or 
phrase; usually it will be the word "Control Кк", 
Respona using the same annunciation and voice ncóulation 
ООШ АЛС auring training. The speech unit will 
sccre your training ability on a scale from 0 to 100. 
Acceptable scores range from 80 to 100. Lower scores 
are an indication that possikle retraining is warrantec. 


2. After the DISPLAY section is completed anc savea, г 
Similar but loncer test will be given. Each response 
will be scored, as well as an averece score given fcr 
that particular section. The test will take abcut 1 
minute. 


14. At the completion of each test session, the speech unit will 


reac: "Score = _ os YeSetor Menu". 
15. Press the YES button. The speech unit vill nov reaa: "Exits 
___ "U, then: "Ааа New User?" (Menu #1). 


l6. At this point if you woulc like to continue with ancther 
section of the TRAINING Phase, simply scroll through the Menu 
(using the NO button) until the speech unit reas: "Retréin Olc 
User?". Ком continue with step 13d. 


l7. If instead you would like fo leg-out at this point, scroll 


through the Menu until the speech unit reads: "Logout?". Fress 
Es button. The speech unit will now reac (in respective 
Order): “Exit ID (your ID ¢); “Logout Supervisor” ("06"); and 


memeer User ID". 


18. ТЕЁ you decide to continue and interface with the MWISS 
wargaming scenarios, the system set-up will have to be modified 
in accordance with Ficure #2, апа then you can continue with step 
#20. 


О 


19. To shut the svstem down, з1гр1у place ail Of спе пси 
cower switches (On/Off switches) to the OFF position. 


20, With tbe VT-102 andà the ADH 3l establish tne зала! сени 
as per procedure l (A-J). The speech unit should пом геаа 
"Enter User ID:". Enter your ID number ancg@eress ec. 


Zl. The speech unit will now reac “Loaainq Patterns for ТЕ “Б 


22. You can set the gain (as per #8 - 1C ) either prior to or 
after the NWISS is brought online. 


23. Upon completion of the came, press the STOP button; ВОВ 
through the Menu #3, anc follow steps 17 and 19. 
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ПРИ" lr 


HELPFUL HINTS 


ШОШ се the enclcsea Werclist as a quiae while going thrcuch the 
EMROLLHERYT Phase. It would also be very beneficial to have stuc:ec 
BENE "or СО attemptinc the phase, as the vcrcs are rresentec too 
ШЕС Со think sbout pronunciation rrior to sreakindg ther. 


EM "t'corfortsblv; preferably directly in front of tne speech unit. 
3. Be ready tc push the STOP button if you make а mistéke. 


 опау the wora list (Enclcsure l) prior to enrolling., Especially 
consider the wordás in the "pronounce" column, Say them naturally. 
DO NOT pause for any word in the ENROLLMENT phase. The spaces in 
that column are to help determine the proper annuncietion of the 
word. It will be necessary to pause in the TRAINING phase, but 
only long enough to distinguish between woras. 


For example, ("FOR KITTY”). 


5. In general, uSe the most natural pronunciation that comes to 
minc. 


6. Pronounce numbers which appear es part of fixec icentifiers, 
Mammen Matural manner (i.e. FI14A as F Fourteen A; MK48 as liark 
Perty-Eicght, ерсе) 


7. Fully pronounce cicgits which appear as part of variable strinas 
(i.e. Altituce 2500 as Altitude Two Five Zero Zero, etc.). 


8. Be consistent with your pronunciations. 
ШЕТ е Select YES/NO light: 

А. This light is on the conscle of the Speech unit. When it 
is illuminated it means press the YES or KO button as 
applicable. 

B. NOTE: This procedure is only true if the speech unit 


reacs a line of a " Menu ", At all other times, only the 
YES button will be accepted. 
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MENU GUIDE 


NOTE: Do not use the follcwing list cf ID nurbers: 00 Chiou 
10 (inelusive),47,69, 70ers 


MENU 3) MENU #2 
This menu is invokec by entering This menu is invokeuwag 
the supervisor mode (i.e. OG into by use of the STOP 
the speech unit) риееоп місһіп ЕНКОГІТЛТЕВ 
Phrase. 
Add New User? Resume Enrollment? 
Test Old User? Reject Last Utterénce? 
Re=-Enroll Olc User? Save Patterns? 
Re=Train Gla User? Logout? 


List User? 
Deiete Gla User? 


Locout? 
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МЕМО #3 


Invokec by completing tne test 
session in the TRAINING phase 


Continue? 
Calibrate? 
Restart? 


bocout? 
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MENU £4 


Invoked by conmencerent 
eet Meer ain ne | 


ам и геаггакг< 2 


Position? 
Track? 
Fire? 
SNIPOrCeEr? 


Airorcer? 


(7 
ej) 


porco 


Launch? 


I 
122% 
T3.: 
l4. 
157 
Eo 
17: 


Ө 


20% 
25 
22% 
сз 


24. 


WORD 


Execute 
BALRASW 
ВСАР2 


ЕСАР] 


FI4STRCAP 


A6STRIKE 


Control sk 


Force 


Track 


Fosition 


Designate 


Neutral 


Friendly 


Enemy 
Display 
Rearing 
For 
ІРОІКТІ 
Sprua 
Misawa 
Losan 
Rathb 
Omaha 


Wich 


WORDS TO BE TRAINED ON THE VERBEX 


PRON Е 


B AIR ASW 
DEG 
BEECAPL 
F FOURIEEN 
STRIKECAP 


A SIXSTRIKE 


del 
SPRUANCE 
MISAWA 

LOS ANGELES 
КАФНРОКК 
OMAHA 


WICHITA 


162 


25: 
2 


21 


46. 
471. 
48. 


49. 


WORD 


Wilso 
knox 
ЫССОЕ 
Kitty 
үт0 


0 


VSO 
VHO 
МЕЈ 
МЕО 
VWO 
VKO 


VFO 


P ОКСЕ 
50и 


[О 
ССС Е 
BON 

'Lb TEE ZELS 


ZERO 


NINE 
УБЕ 5 2ЕКО 
VEE HERG 
МЕР БИ 
VEE E ZERO 
VEE W ZERO 
МЕЕ КЛ АБК 
VEE Е ZERO 
VEE A ZERO 
SOT 


M- PEE SI? 


(not niner) 


a ы м ммЦ 74 


10. 
poe 
712. 
Кз. 
78. 
5. 


76. 


Viac 
Metro 
Alexs 
VWonsa 
Erase 
ЕСІ 
ГОВ 
ESN 
Sonar 
Drop 
Cancel 
Gria 
Circle 
АМАВК 
All 
Place 
Center 


Raaius 


W 


BUO 
BSO 
BPO 


ВЕО 


PETRO 


WANDSA 


ERS Td 


2 mark 


ТАСК 

NORTH 

EAST 

WEST 

SOUTH 

BEE YOU ZERO 
BEE S ZERO 
BEE P ZERO 


ВЕЕ Е ZERO 


100. 


101 


M2. 


683. 


1417 


ВАО 
Tonhk 


Brron 


Cruise 


875251016 
УКАбА 
МК46 


MK48 


Torpedo 


At 


Range 


Orcers 


Take 
DECH 
orr 
Оп 
RBOCK 


PIE 


Launch 


Weapons 


Free 


Subrarine 


Surface 


Air 
duret 
EMCON 


Surf 


BEL OA ZERO 
TOLOERANE 


Фр 


me ROCK 


MARK FORTMSIx А 


MARK FORTYSIX 


MARK РОВТУЕТСНТ 


AT (спе worc) 


pee CO 


АВВОСЕ 


MCON 


SURF 


104. 
iG Se 
ELG: 
Doy. 
E. 
209. 
ш 
FEL; 
12% 
I3. 
114. 


> 


AIRS AIRS 13055 02 S SC SIXTI 
АБУ А БИ 131. 55 S 65 С ЕТЕТҮТЕКЮВЕ 
Silen SILENT 112. 258 S S C FORTY Din 
Radia RADIATE 132.7А6Е & SIXOE 
Fire 134. А7Е A SEVEIUSE 
Station meon TELG E T OCRE 
Рег15соре 136. ЕАЗВ E AIT ЕЕ 
Dect: 137. EA6B ЕД SITE 
Course 138. Е14А F FOURTEEN EA 
Speed 139. F14T F FOURTEEN T 
Ргосееа 140. KA6D K A SIX D 
Barrier ВЕ. в PEE THREE CED 
Nission 142. 53А S THREE 
ASW A SW as. SH3SD о БЕ ЕЕ ee 
SURCAP SURONPE 144. SH2F S H Tho F 
Search 145. HARP HARP 
CAP 146. HK82 МАКЕ ЕТСНТУТУО 
Airtanker 147. HK83 МАКК ЕТСНТУТНЕВЕ 
STRCAF SLRIKECEP 148. MK84 MARK EIGHTYFOUR 
Strike 149. Рћепх PHEENIX 
Cover ОВ ЕС они SHRIKE 
Altitude ISl- Spar SPARROW 
Bingo 1525 Sweex SICE ВЕ 
Refuel 153. Шаш WALLEYE 
үк00 VEE K ZEROZEKO 154. гоаа 
50538 S Q FIVE 155, Stop 

ITHIRTYEIGET 


ENCLOSURE (1) 
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TRAINING PHASE; EXAMPLES OF WORD COMBINATIONS 


NWISSGRAMJ 
Beering Track 
Eo-O008 

ут-001 

BAIRASW 

Designate Neutral 
Display 

Execute Pl4STECAP 
МЕ—068 

Fosition 

sae 105 

bon l Pointl 


FOr Knox 


POSITION 


> 
© 
e 


FORCE 
VE-100 
rod 
VK-003 
ME 023 


VH-604 


Spruance 


Aleks 
Vlad 
Misawa 
Wilson 


MS GU 


Ratbburn 


TRACK 


EU 
BU-009 
BE-026 
BA-034 
BP-047 
ES 0182 
БЕ 9 
BA-057 
Ip 


bea 


ENCLOSURE (2) 


лес 


DISPLAY 

Pacius 3 4 

Ios 

Brase LOB ESL 
Pilg FOB Sonar 
Cancel Circle All 
ресе Cria аск 


Center Force 


Cancel Circle Posit 


Place Gria Force 
Place XMark Force 
Flace XHark Posit 


Center Fos ition 


FIRE 


8 4 9 

СЕКТОРЫН Cruise 
Bearinc 5 7 

3 АЗКОС Тогреао 
At Aleks 

At Wonsa 

Peco 

глог Cruise 
4 Hrpn Cruise 


5 MK46A Torpedo 


SHIPORDER 


Free Enemy Surt 
Course 4 5 

| pec Ore 
срееа 3 2 
Weapons Tight 
1 С 

Free Enemy Sub 
9 cay 

ARBOC 

Free Eneny А11 
DESCANT TON 


Course 5 4 


A RDER 


Free Eneny Air 
Weapons Ticht 
EINGO 

Refuel VK-000 
eS 

Mission Strike 
Speed 4 9 
Mission Cap 
Mission AEW 
Cover 

Hissicn Search 


Mission Strkcap 


NE 


Controtems 


3 


о. 


1 


2 


7 


6 


4 


5 


0 


6 


LAUNCH 


ҺАөӨр Fl4A 7 


(6 ҺАР 


Ргосеес РОР 


БӘС SS 
АЛЕ AGE 5 


3 2 Sicevnar 


0 < 550-002 
ЕО 
241 МК 84 


Р14А 5Р2Е 
KA6D F14T 9 


4 3 50550 


Configuration to Train 
Yoice Patterns on 


the Verbex 5000 





VT-102 ADM 51 


SPEECH UNIT 





МЕКВЕХ 3000 





** : THE ADAPTER IS STAMPED: ” VERBEX ONLY ^. 


NOTE: THE DIAGRAM DEPICTS VIEWING THE 
MACHINES FROM THE REAR. 





FIGURE 41 
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Configuration to Run 
NWISS on the 
Yerbex 3000 


ADM 31 


VT-102 


SPEECH UNIT 


он 
"ГІШ 
OFF 
NULL 
WIRE MODEM 
TAGGED 
#15 





МЕКВЕХ 3000 





** : THE ADAPTER IS STAMPED: 7 УЕВВЕХ ОМГҮ ^. 


NOTE: THE DIAGRAM DEPICTS VIEWING THE 
MACHINES FROM THE REAR. 


FIGURE *2 
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МОТЕ: 
MICROPHONE POSITION IS CRITICAL, THE 
MICROPHONE SHOULD BE NO MORE THAN 1/2 
INCH FROM THE LIPS WITHOUT TOUCHING THEM. 
(IE. AS SHOWN IN THE FIGURE ABOVE) 





THE MICROPHONE POSITION SHOULD BE OOTY 
Ман LOWER THAN THE CENTER OF 
THE MOUTH. 


FIGURE 73 
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APPENDIX G 


MACINTOSH MICROCOMPUTER USERS GUIDE 


The purpose ir accomplishing this tréinina is COo Dro ШШШ 
clay various КГІ55 Warcame Scenarios as an Aircraft CM 
Battle Grour Conmander during the course of the indiviaual реса 
trial. Commands for the game will be entered usince the pcint 
select method to builc acceptable comnranás in the расе и 
conventicnal keyboard. 


To accomplish the necessary training, utilize the Боан и 
Steps to attempt to gain some skill in building commanas: 


1. Reach around to the left side of the MAC, and turn ІРІ 
uSing the rocker switch on the upper left sice of the back. Place 
the mini-aisk, label up, in the slct on the lower right of the 
front, with the metal tab entering the slot first. (NOTE: It is 
not necessary to open the tab first as it is done autonatically 
by the crive.) Wait for the system to load itself (which may take 
a little over a minutes 


2. You will see a esk top with two or more file icons. Using 
the mouse, move the arrow to the icon labeled "Offline Trainina", 
and with the arrow placec anywhere on the icon, click the mouse 
button twice. The program, which conditions the МАС аз ап №156 
terminal, will now load and run itself. 


3. When the loac is complete you will see a series of colunn 
headers along the top of the desk top (i.e. “NR" contains numbers, 
etc.). At this point you are actually corresponcinG "nM 
procram written in BASIC. This procram provides menus cf conmane 
worcs from a limited vocabulary. It supports sequential selection 
of these words and their associated aisplay (in an orderly fashion 
on the screen) in order to allow the build-up of full commands, 
The program also accomplishes communications with the VAX ance 
returns information from the VAX to the screen; sinilar to the 
output proviced by the VT100 terminal. To select a vorc ОНЕ 
menu use the mouse to position the arrow on the menu title along 
the top of the screen, push down the mouse button, and hold it 
down. The menu will extend downward in its own window (see the 
attached example menus). Continue to hela the mouse button own 
while you move the mouse to position the arrow on the мога оѓ 
your choice. When the arrow is over each word it will be hichlightea. 
To select one of the words simply let up on the button. The 
wincow will disappear and the word will be aisrlayed on the cesk 
top. When a command is complete, move to the right-most column 
and select "EXECUTE ORDER” from this menu. The VAX will respona 
to the order when the system is “on-line” in the гГписпге нон 
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Ке лас practice sessions can Still be obtainec in the "off-line" 
косе. 


4. Notice that the richt-most menu contains a selection for 
"BANUAL EKTRY"™. This allows you to type in the worcs that are 
otherwise not on the menus. The Key uncer your left palm with an 
ПИ СУ Sich is the control key. Use the celete key to back out 
errors in this moae. Cnce you have selectec tnis moce , уси must 
then type your cesirecd word and clcse the session with an "*" 
ШЕП will take you back to mouse control. Now “EXECUTE ORDER" 
must Се selectea from the last menu in orcer to complete the corrana. 


S. To terminate the session, select "OUIT РЕОСРАК" on tne 
right most menu. At the next winaow under the FILE menu Select 
"QUIT", and under the next window under the FILE menu select 
"EJECT". When the mini-floppy disk is ejecteg, turn the machine 
off with the switch in the back. 
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